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Abstract 

Sponsored  by  Air  Combat  Command  (ACC),  the  purpose  of  this  research  was  to 
examine  the  impact  that  current  USAF  Quality  Assurance  (QA)  manning  practices  has  on 
key  aircraft  wing-  and  unit-level  metrics. 

Interviews  and  surveys  culminated  in  development  of  a  QA  Manning 
Effectiveness  Matrix.  We  then  used  the  matrix  to  calculate  historical  QA  manning 
effectiveness  at  16  ACC  bases.  Effectiveness  scores  were  regressed  with  associated 
historical  data  for  26  metrics  derived  from  a  Delphi  survey.  Nine  metrics  were  deemed 
statistically  significant,  including  break  rates,  cannibalization  rates,  flying  schedule 
effectiveness  rates,  key  task  list  pass  rates,  maintenance  scheduling  effectiveness  rates, 
quality  verification  inspection  pass  rates,  repeat  rates,  dropped  objects  counts  and 
safety/technical  violations  counts.  An  example  benefit  cost  analysis  for  changes  in  QA 
manning  effectiveness  was  performed,  using  reasonable  cost  values.  The  results  present 
compelling  evidence  for  aircraft  maintenance  managers  to  carefully  weigh  decisions  to 
leave  QA  manning  slots  empty,  or  to  assign  personnel  possessing  other  than  authorized 
credentials.  Furthermore,  aircraft  maintenance  managers  can  use  this  tool  to  help 
determine  mitigating  strategies  for  improving  unit  performance  with  respect  to  the  nine 
metrics. 
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EXAMINING  THE  IMPACT  OF  QUALITY  ASSURANCE  MANNING 
PRACTICES  IN  USAF  AIRCRAFT  MAINTENANCE  UNITS 

I.  Introduction 

Overview 

USAF  combat  aircraft  flying  units  are  the  main  focus  of  this  research.  These 
flying  units  require  thousands  of  maintenance  technicians,  all  performing  a  myriad  of 
distinctive  and  specialized  functions  in  order  to  safely  execute  launch,  recovery, 
servicing,  re-anning,  and  modification  operations.  Key  to  ensuring  that  the  countless 
critical  steps  involved  in  these  activities  are  executed  according  to  written  direction  is 
having  proactive  and  involved  leadership  and  management  at  all  levels  of  execution. 
However,  since  the  effective  reach  of  unit  leaders  and  managers  is  extremely  limited, 
they  rely  heavily  on  a  highly  structured  cadre  of  experienced  and  skilled  technicians  who 
provide  daily  oversight,  an  on-the-spot  correction  capability,  training,  an  investigative 
capacity,  and  a  mechanism  for  formal  feedback  to  leadership  to  use  for  analysis  and 
possible  future  mitigation  of  underlying  causal  factors.  This  cadre  of  experts  is  formally 
known  as  the  Maintenance  Group  Quality  Assurance  Flight. 

Problem  Statement 

Mid-level  Air  Force  managers  and  leaders  in  aircraft  maintenance  units  need  to 
know  the  potential  mission  impact  of  leaving  validated  Unit  Manpower  Document 
(UMD)  authorized  Quality  Assurance  (QA)  manpower  positions  unfilled  or  of  assigning 
personnel  with  mismatched  Air  Force  Specialty  Codes  (AFSC)  against  these  positions. 
This  research  will  attempt  to  systematically  identify  and  quantify  possible  impacts  and 
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consequences  that  leaving  QA  manpower  positions  unfilled  or  “mismatching”  personnel 
against  QA  manpower  slots  designated  on  the  Unit  Manpower  Document  (UMD)  could 
have  on  safety,  quality,  and  mission  capability  factors  in  order  to  assist  Air  Force 
maintenance  managers  when  making  these  important  QA  manning  decisions. 

Background 

Recent  research  conducted  at  the  Air  Force  Institute  of  Technology  revealed  a 
statistical  correlation  between  aircraft  mission  capable  rates  (the  primary  metric  in  the 
USAF  that  measures  the  percentage  of  assigned  aircraft  capable  of  meeting  their  primary 
mission),  and  manning  levels  along  with  experience  levels  of  assigned  aircraft 
maintenance  personnel  (Oliver,  2001).  This  study  attempts  to  build  on  this  premise  by 
focusing  on  one  high-demand;  low-density  manpower  resource  -  the  aircraft/munitions 
maintenance  quality  assurance  (QA)  flight. 

A  1996  General  Accounting  Office  (GAO)  report  to  the  U.S.  Senate  Subcommittee 
on  Acquisition  and  Technology,  Committee  on  Armed  Services  stated  that  Based  on 
studies  performed  for  DOD,  we  estimate  that  it  spends  more  than  $1.5  billion  annually 
beyond  what  is  necessary  to  support  its  quality  assurance  approach  (GAO,  1996). 
Furthermore,  traditional  quality  assurance  techniques  have  historically  relied  upon  many 
after-the-fact  inspections,  increasing  costs  in  both  time  and  money.  To  remain  profitable, 
manufacturers  switched  from  detection,  to  prevention-based  quality  strategies  which 
replaced  end-item  inspections.  Although  the  approach  in  the  GAO  report  is  primarily 
procurement  and  acquisition-related,  prevention-based  quality  strategies  has  not  become 
a  reality  in  the  United  States  Air  Force  (USAF).  More  specifically,  we  in  the  Air  Force 
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still  rely  heavily  on  our  traditional  QA  as  a  detection  function  to  catch  problems  before 
they  escalate. 

Furthermore,  the  GAO's  analysis  of  data  reported  by  all  services  showed  that 
human  error  con  tributed  to  seventy-three  percent  of  Class  A  flight  mishaps  in  Fiscal 
Years  1994  and  1995.  In  Air  Force  mishaps,  human  error  was  a  factor  seventy-one 
percent  of  the  time.  For  the  Army,  the  figure  was  seventy-six  percent.  According  to  the 
Naval  Safety  Center,  human  error  was  a  factor  in  eighty  percent  of  the  Navy  and  Marine 
Corps  Cl  ass- A  mishaps  for  Fiscal  Years  1990  through  1994.  The  fact  that  nearly  three- 
fourths  of  accidents  have  a  human  error  factor  doesn't  necessarily  mean  that  the  human 
caused  the  problem.  Often,  some  other  problem  occurs,  but  at  some  point  the  human 
could  have  or  should  have  intervened  to  change  the  course  of  events— and  that  someone  is 
not  always  the  pilot.  It  could  be  anyone  from  the  air  traffic  controller,  to  the 
maintenance  crew  (GAO,  1996). 

This  point  was  tragically  highlighted  in  May  1995,  when  an  F-15  pilot  was  killed 
shortly  after  takeoff  from  one  of  our  air  bases.  According  to  a  1998  “Aerospace  World” 
report,  the  accident  investigation  revealed  that  a  mechanic  accidentally  crossed  flight 
control  rods  in  the  aircraft  while  reinstalling  them  and  another  mechanic  failed  to  catch 
the  miscue  which  made  the  jet  impossible  to  control  in  the  air  (Grier,  1998).  Also 
according  to  the  same  report,  several  previous  incidents  in  which  other  mechanics  made 
the  same  mistakes  should  have  alerted  the  Air  Force  to  a  potential  problem.  In  fact,  the 
review  board  noted  that  similar  crossed-rod  cases  occurred  at  least  twice  before,  but  in 
both  instances,  the  problem  was  caught  before  takeoff.  Although  the  Air  Force  has  since 
taken  steps  to  ensure  this  mistake  doesn ’t  happen  again  by  color-coding  the  control  rods 
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and  adding  a  warning  to  the  technical  manuals  (Grier,  1998),  catching  these  types  of 
design  issues  and  ensuring  flight-critical  inspections  are  performed  correctly  are 
fundamental  to  the  QA  function. 


Figure  1  -  F-16  Maintenance-Related  Mishap  (Photo  Courtesy  of  USAF  Safety  Center) 

In  several  recent  incidents,  the  impact  of  improper  maintenance  was  deeply  felt.  In 
the  first  case,  an  airman  was  performing  an  F-16  engine  run  at  one  of  our  bases  when  it 
“jumped”  over  the  wooden  wheel  chocks  designed  to  keep  the  aircraft  from  moving  (see 
Figure  1).  The  F-16  subsequently  came  to  rest  on  its  side  damaging  its  right  wing,  nose 
gear,  and  right  landing  gear.  In  a  review  of  the  mishap’s  factual  data  by  the  Air  Force 
Safety  Center’s  aircraft  maintenance  expert,  the  following  maintenance-related  facts  were 
foundational  to  this  mishap  (Moening,  2005): 

•  Using  bad  chocks  (training  and  lack  of  management  oversight). 
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•  A  temperature  condition  that  provided  more  thrust  than  expected  (training). 

•  The  technician  had  no  previous  training  on  what  to  do  if  the  jet  jumped  chocks; 
the  technician  was  following  all  unit  procedures,  but  unit  supervision  chose  to 
allow  engine  runs  on  packed  snow  and  ice  and  didn 't  think  the  ‘  jump  chocks 
training”  was  important  (gross  leadership  failure)  (Moening,  2005). 


Figure  2  -  F-15  Maintenance-Related  Mishap  (Photo  Courtesy  of  USAF  Safety  Center) 

Another  incident  provides  further  proof  of  the  value  of  correct  maintenance.  In  this  case 
an  F-15  aircraft  was  extensively  damaged  when  an  avionics  access  door  came  unlatched 
in  flight  (see  Figure  2).  In  a  review  of  the  mishap’s  factual  data  by  the  Air  Force  Safety 
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Center’s  aircraft  maintenance  expert,  the  following  maintenance-related  facts  were 
foundational  to  this  mishap  (Moening,  2005): 

•  During  Phase  inspection,  the  securing  rings  for  the  fasteners  were  not  installed 
(training,  procedural  error,  and  lack  of  management  oversight). 

•  The  panel  was  incorrectly  secured  after  "red  ball"  maintenance  (training, 
procedural  error,  and  lack  of  management  oversight)  (Moening,  2005). 

A  final  example  tries  to  answer  a  famous  physics  question:  What  happens  when 
an  irresistible  force  meets  an  immovable  object?  In  this  case,  the  aircraft  was  on  the 
losing  end  and  a  multi-million  dollar  fighter  jet  was  severely  damaged  (see  Figure  3). 


Figure  3  -  F-16  Maintenance-Related  Mishap  (Photo  Courtesy  of  USAF  Safety  Center) 
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The  scenario  involved  an  F-16  being  towed  during  nighttime  hours  when  it  impacted  an 
aircraft  clear-water  rinse  structure.  The  jet’s  nose  landing  gear  subsequently  collapsed 
causing  extensive  damage  to  the  nose  landing  gear,  nose  gear  well,  nose  radome,  and 
engine  inlet  structure.  In  a  review  of  the  mishap’s  factual  data  by  the  Air  Force  Safety 
Center’s  aircraft  maintenance  expert,  the  following  maintenance-related  facts  were 
foundational  to  this  mishap  (Moening,  2005): 

•  The  tow  team  supervisor  who  had  only  been  on  base  one  month  was  improperly 
trained  (training  consisted  of  being  told  “ here's  the  book,  read  it")  (failure  of 
leadership). 

•  The  tow  crew  veered  to  the  right  of  taxiway  center  line  for  no  discernable  reason 
resulting  in  the  aircraft  impacting  the  clear-water  rinse  structure  (training  and  lack 
of  management  oversight)  (Moening,  2005). 

These  are  all  eye-opening  examples  of  the  importance  of  proper  maintenance  which 
further  underscore  the  criticality  of  maintenance  leadership,  management,  and  oversight. 

Maintenance-Related  Mishaps,  Recent  History 

Table  1  explains  the  three  mishap  classes  used  in  the  USAF  for  both  Flight  and 
Ground  categories  while  Figures  4  through  6  provide  a  high-level  view  of  the  impact  that 
improper  maintenance  has  on  USAF  mission  readiness  (note  the  middle  columns  in  each 
individual  FY  in  Figures  4  through  6  indicate  maintenance-related  mishaps  only). 
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Table  1  -  Air  Force  Mishap  Classifications 


MISHAP  CLASSIFICATIONS 

Category 

Results  in ... 

and/or... 

and/or ... 

CLASS-A 

>$1  million  in  damages 

Permanent  Disability 

Destruction  of  an  Aircraft 

CLASS-B 

$200  thousand  to  $1 
million  in  damages 

Permanent  Partial  Disability 

Inpatient  hospitalization  for 
three  or  more  personnel 

CLASS-C 

$20  thousand  to  $200 
thousand  in  damages 

An  injury  causing  loss  beyond 
the  shift  or  day  it  occurred 

Occupational  illness  or 
injury  causing  a  permanent 
change  of  job 

Class  A  Mishaps 

Attributed  to  Maintenance 


FYOO  FYOI  FY02  FY03  FY04 

Note:  AF  mishaps  are  total  of  ail  mishaps. 


■  AF 

■  MX 

□  AETC 


Figure  4  -  Class-A  Mishap  Data  (Source:  USAF  Safety  Center) 
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Note:  AF  mishaps  are  total  of  all  mishaps. 
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Figure  5  -  Class-B  Mishap  Data  (Source:  USAF  Safety  Center) 


Class  C  Mishaps 

Attributed  to  Maintenance 
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Note:  AF  mishaps  are  total  of  all  mishaps. 
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Figure  6  -  Class-C  Mishap  Data  (Source:  USAF  Safety  Center) 
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Furthermore,  in  Fiscal  Year  2004  alone,  USAF  maintenance-related  mishaps  cost  U.S. 
taxpayers  $24,573,947.  The  following  is  breakdown  of  those  costs  by  mishap  category: 

•  Class  A  Mishaps  -  $10,433,572 

•  Class  B  Mishaps  -  $5,584,814 

•  Class  C Mishaps  -  $8,555,561 

According  to  a  2005  USAF  Safety  Center  Report,  this  is  enough  money  to  pay  for 

•  5.4  -  F100-PW-229  Engines  at  $4.5  Million  each,  or... 

•  652  -  GBU-31  JDAMS  (Joint  Direct  Attack  Munitions)  at  $37,670  each,  or... 

•  722, 763  -  man-hours  at  $34  per  hour 

Maintenance-related  mishaps  create  a  massive  opportunity  cost  or  more  specifically  loss! 
The  following  is  a  top-ten  breakout  of  what  caused  these  maintenance-related  mishaps 
(Moening,  2005): 

1)  Failure  to  follow  published  Technical  Data  or  local  instructions 

2)  Using  an  unauthorized  procedure  not  referenced  in  Technical  Data 

3)  Supervisors  accepting  non-use  of  Technical  Data  or  failure  to  follow  maintenance 
requirements 

4)  Failure  to  document  maintenance  in  the  AFTO  Form  781  or  engine  work  package 

5)  Inattention  to  detail/complacency 

6)  Incorrectly  installing  hardware  on  an  aircraft/engine 

7)  Performing  an  unauthorized  modification  to  the  aircraft 

8)  Failure  to  conduct  a  tool  in  ven  tory  after  completion  of  the  task 

9)  Personnel  not  trained  or  certified  to  perform  the  task 

10)  Ground  support  equipment  improperly  positioned  for  the  task 
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Since  QA  functions  have  historically  been  a  critical  process  within  any  effective 
maintenance  organization,  the  key  to  a  aircraft  maintenance  QA  flight’s  effectiveness  are 
the  “qualities”  of  personnel  assigned  to  the  very  limited  manning  slots.  The  criticality  of 
this  concept  is  best  illustrated  by  examining  the  composition  of  an  average  active  duty 
USAF  aircraft  flying  wing. 

In  order  to  get  the  “right”  personnel  mix,  the  Air  Force  performs  extensive 
manpower  studies  to  detennine  with  great  precision  the  proper  AFSC  and  skill  level 
combinations  needed  to  populate  a  QA  shop  to  enable  it  to  perform  its  duties  to  include 
all  exercise,  war,  and  peacetime  tasks.  However,  because  of  resource  constraints  and  a 
very  high  demand  for  this  low-density,  high-demand  capability,  maintenance  managers 
and  leaders  are  sometimes  forced  to  make  tradeoffs  when  deciding  how  to  man  QA 
manpower  slots. 

Faced  with  constricted  manning  resources,  maintenance  leaders  responsible  for 
staffing  QA  are  often  forced  to  make  difficult  decisions  to  deviate  from  the  UMD  and 
substitute  AFSCs  or  possibly  even  leave  a  QA  manning  slot  vacant.  Although  these 
substitution  and  vacancy  decisions  are  not  made  in  a  vacuum,  the  potential  impact  of  the 
“deal”  is  sometimes  lost  in  the  dilemma  to  either  “fill  a  QA  slot”  or  continue  to  produce 
maintenance  on  the  flight  line/in  the  maintenance  shops.  This  is  because  no  tool 
currently  exists  to  help  maintenance  managers  making  these  decisions.  This  means  they 
must  rely  wholly  on  past  experience  and  a  “gut”  feel  which  could  become  a  problem  for 
inexperienced  maintenance  managers. 
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The  Research  Question 


This  research  seeks  to  answer  the  question:  What  effect  does  “mismatching” 
AFSCs  or  leaving  unit  manpower  document  (UMD)  authorized  manpower  positions 
unfilled  in  wing  aircraft  maintenance  QA  units  have  on  unit-  or  key  wing-level  measures? 

The  Investigative  Questions 

Multiple  questions  were  addressed  in  order  to  answer  the  research  question: 

1)  Which  key  unit-  and  wing-level  metrics  are  most  affected  by  an  empty  QA 
manning  position  or  an  AFSC  mismatch? 

2)  How  effective  is  a  worker  when  assigned  to  a  QA  duty  position  requiring  a 
different  UMD-authorized  AFSC  (how  good  is  the  “fit”)? 

3)  What  is  the  relationship  between  QA  manning  effectiveness  and  key  unit-  and 
wing-level  metrics? 

Overview  of  Remaining  Chapters 

In  this  chapter  we  introduced  the  problem  and  provided  some  background 
information.  In  Chapter  II,  we  review  the  literature  examined  to  gain  insight  into  the  QA 
construct  along  with  how  the  Air  Force  allocates  and  assigns  manpower  to  QA  flights. 

We  also  review  some  of  the  more  important  types  of  metrics  found  in  Air  Force 
maintenance  organizations.  In  Chapter  III,  we  examine  the  methodology  used  in  the 
study.  In  Chapter  IV,  we  create  maintenance  effectiveness  ratings  for  the  16  bases 
participating  in  the  study  and  in  Chapter  V,  we  apply  these  Effectiveness  ratings  to  the 
different  metric  data  types.  Lastly,  in  Chapter  VI,  we  provide  conclusions  and 
recommendations  for  future  research. 
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II.  Literature  Review 


Overview 

This  chapter  summarizes  the  foundational  literature  this  research  used.  Numerous 
publications  are  dedicated  to  employee  performance  but  few  investigate  the  link  between 
Quality  Assurance  (QA)  and  employee  performance  and  the  ones  that  do,  are  oftentimes 
found  in  accident  or  incident  reports.  This  research  begins  with  an  example  of  QA’s 
importance  in  a  commercial  aviation  setting.  We  then  investigate  the  Air  Force  construct 
relating  to  QA. 

The  Commercial  Aviation  Industry  Link 

On  May  11,  1996,  ValueJet  Flight  592,  a  DC-9-32  passenger  aircraft  caught  fire 

in-flight  and  crashed  into  the  Florida  Everglades.  The  crash  killed  110  people  and  was 

attributed  to  contract  maintenance  personnel  improperly  rendering  safe  and  shipping 

oxygen  cylinders  in  the  cargo  hold  of  the  aircraft.  The  National  Transportation  Safety 

Board  Investigation  report  cited  numerous  contributing  factors  behind  the  crash: 

The  continuing  lack  of  an  explicit  requirement  for  the  principal  maintenance 
inspector  of  a  Part  121  operator  to  regularly  inspect  or  surveil  Part  145  repair 
stations  that  are  performing  heavy  maintenance  for  their  air  carriers  is  a 
significant  deficiency ...  Improper  maintenance  activities  and  false  entries  pose  a 
serious  threat  to  aviation  safety  and  must  be  curtailed. 

This  observation  is  referring  to  the  fact  that  ValueJet  subcontracted  their  heavy 

maintenance  work  out  to  Sabre  Tech  who  perfonned  the  maintenance  on  the  oxygen 

canisters  for  ValueJet.  The  report  then  linked  this  observation  to  the  need  to  have  the 

right  number  of  people  in  the  right  jobs  with  the  following  ruling: 

In  part  because  he  was  responsible  for  so  many  operators,  the  principal 
main  tenance  inspector  assigned  to  oversee  the  Sabre  Tech  facility  in  Miami  was 


13 


unable  to  provide  affective  oversight  of  the  ValueJet  heavy  maintenance 
operations  conducted  at  the  facility. 

And  finally,  the  report  stated  the  reason  for  the  crash  was: 

ValueJet  failed  to  adequately  oversee  Sabre  Tech  and  this  failure  was  the  cause  of 
the  accident.  (NTSB,  1997). 


Understanding  the  Quality  Assurance  Construct 

The  purpose  of  Quality  Assurance  within  the  Department  of  Defense  (DoD)  was 

initially  established  in  the  former  DoD  Directive  4155.1  which  stated: 

The  primary  purpose  of  quality  assurance  is  the  enforcement  of  technical  criteria 
and  requirements  governing  all  materials,  data,  supplies,  and  services  developed, 
procured,  produced,  stored,  operated,  maintained,  overhauled,  or  disposed  of  by 
or  for  the  DoD. 

Although  this  directive  no  longer  exists,  the  concept  is  still  valid  and  quality  assurance 

(previously  known  as  quality  control),  continues  to  be  a  critical  tool  to  a  manager’s 

ability  to  keep  abreast  of  the  health  of  their  organization.  L.  Marvin  Johnson,  a 

Registered  Professional  Quality  Engineer  and  author  with  forty-eight  years  of  experience 

in  quality  assurance  and  related  fields  summed  up  the  concept  very  succinctly: 

Involved  management  and  discipline  is  the  key  to  quality.  Evaluations  are  the 
investigations  that  determine  the  extent  of  an  activity ’s  ability  to  implement  and 
maintain  the  self  controls  necessary  to  administer  an  effective  quality  program 
(Johnson,  1990). 

“In  the  U.S.  Navy,  the  process  for  ensuring  adherence  to  maintenance  standards 

involves  a  quality  assurance  function  designed  to  perform  inspections,  audits  and  quality 

checks  on  flight  equipment  and  maintenance  processes”  (OPNAVINST  4790,  chap  14). 

The  following  excerpt  overviews  the  purpose  behind  the  Navy’s  QA  program: 

QA  provides  a  systematic  and  efficient  method  for  gathering,  analyzing,  and 
maintaining  information  on  the  quality  characteristics  of  products,  the  source  and 


14 


nature  of  defects,  and  their  immediate  impact  on  the  current  operation.  It  permits 
decisions  to  be  based  on  facts  rather  than  intuition  or  memory  and  provides 
comparative  data  which  is  useful  long  after  the  details  of  the  particular  time  or 
events  have  passed.  The  objective  of  QA  is  to  readily  pinpoint  problem  areas  in 
which  management  can: 

1)  Improve  the  quality,  uniformity,  and  reliability  of  the  total  maintenance  effort. 

2)  Improve  the  work  environment,  tools,  and  equipment  used  in  the  maintenance 
effort. 

3)  Eliminate  unnecessajy  man-hour  and  dollar  expenditures. 

4)  Improve  training,  work  habits,  and  procedures  of  maintenance  personnel. 

5)  Increase  the  excellence  and  value  of  reports  and  correspondence  originated  by 
maintenance  personnel. 

6)  Effectively  disseminate  technical  information. 

7)  Establish  realistic  material  and  equipment  requirements  in  support  of  the 
maintenance  effort  (OPNAVINST  4790.2H,  2001). 

OPNAVINST  4790. 2H  continues  on  to  describe  the  Navy  QA  function  as  a  small  group 

of  experts  who  perform  quality  checks,  inspections,  and  audits  in  order  to  collect  data 

and  monitor  trends  with  the  objective  of  improving  processes. 


The  Link  Between  Management,  Experience,  and  Quality  Results  in  the  Workplace 

In  1976,  the  Navy  Personnel  Research  and  Development  Center  conducted  a 
study  to  determine  the  relationship  between  the  “operational  effectiveness  of  U.S.  Navy 
ships  and  the  manning  level  of  selected  enlisted  ratings.  The  relationship  between 
manning  levels  and  ship  performance  were  investigated  on  105  naval  ships  for  the  period 
January  1972  to  January  1975.  Manning  levels  in  the  study  were  expressed  as  the  ratio  of 
the  number  of  personnel  allocated  to  the  ships  to  the  number  authorized  and  scores 
achieved  on  final  battle  problems  following  refresher  training  were  used  as  the  measure 
of  ship  performance.  Correlation  coefficients  were  computed  between  manning  level  and 
performance  for  various  combinations  of  the  independent  variables,  and  were  tested  for 
statistical  significance.  In  general,  an  increase  in  the  number  of  personnel  in  the  lower 
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pay  grades  tends  to  degrade  ship  performance  and  an  increase  in  the  number  of  personnel 

in  the  higher  pay  grades  tends  to  improve  ship  performance.”  The  study  recommended: 

...caution  be  used  in  reducing  manpower  allocated  to  ships,  especially  in  the 
higher  pay  grades.  To  the  extent  possible,  billets  in  the  higher  pay  grades  should 
not  be  filled  with  personnel  in  lower  pay  grades.  (Holzbach,  1991). 

The  results  of  this  study  underscore  the  concept  that  having  more  personnel  with  higher 

experience  levels  (i.e.  those  in  higher  pay  grades)  leads  to  higher  level  results. 

In  another  study  conducted  by  the  Naval  Surface  Weapons  Center,  a  loss  control 

system  was  described  which  employed  management  introspect  for  determining  the 

underlying  causes  of  accidents  and  hazardous  situations,  and  to  improve  the  overall 

effect  of  accident  prevention  activities.  Monetary  and  productive  waste  and  losses,  as 

well  as  accidents,  were  reduced  by  using  accidents  and  hazards  as  indicators  to  detect 

management  failures.  Further,  procedures  were  outlined,  together  with  examples  to 

demonstrate  how  investigation  of  minor  injuries  and  unsafe  conditions  can  identify  the 

management  failures  which  are  causing  huge  hidden  losses  as  well  as  accidents.  A 

logical  method  was  given  to  track  the  primary  cause  of  accidents  and  hazards  back  to  the 

underlying  management  failures.  Management  failures  were  placed  in  general 

categories  and  summarized  to  determine  and  locate  problem  areas  (Fine,  1975).  The 

process  described  here  underscores  the  critical  impact  of  management’s  oversight  on  safe 

task  accomplishment  by  the  workforce.  Aircraft  maintenance  QA  is  this  oversight. 

A  study  conducted  at  the  Naval  Post  Graduate  School  investigated  Naval 

Aviation’s  efforts  to  reduce  its  mishap  rate.  The  study  highlighted  that  management 

focus  has  logically  expanded  to  include  maintenance  operations.  It  further  stated  that 

human  error  is  accepted  as  a  causal  factor  in  at  least  eighty  percent  of  all  mishaps,  with 
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maintainer,  line,  or  facility-related  factors  accounting  for  one  out  of five  major  mishaps 
(Hernandez,  2001).  Again,  this  underscores  the  concept  that  leadership  and  management 
understands  the  link  between  accidents  and  human  frailty. 

The  following  excerpt  from  a  U.S.  Anny  Safety  Center-issued  report  directly 
supports  this  claim: 

Accidents  during  maintenance  activities  are  an  indication  of  operational 
weaknesses  that,  in  combat,  would  quickly  deplete  our  maintenance  capability 
and  affect  readiness.  Maintenance,  which  keeps  the  troops  on  the  move,  is  filled 
with  risks.  Eliminating  or  reducing  those  risks  is  a  key  part  of  carrying  out  the 
maintenance  mission.  The  key  to  reducing  risks  to  acceptable  levels  is  training  to 
standard  and  enforcing  standards.  (USASC,  1991). 

This  report  specifically  focuses  on  the  leading  causes  of  accidents  in  maintenance 

operations  and  provides  general  countenneasures  for  those  accidents. 

Furthermore,  the  universality  of  the  issues  behind  having  the  right  types  of 

manpower  and  getting  desired  results  must  not  be  overlooked.  In  the  mid  1980s,  the 

Turkish  Air  Force  changed  its  centralized  aircraft  maintenance  system  to  the  combat 

oriented  maintenance  system  for  the  F-16  implementation.  They  did  this  to  take 

advantage  of  the  new  system ’s  inheren  t  ability  to  contribute  to  operational  readiness  and 

sustainability  and  to  allow  more  efficient  management  of  manpower  resources.  This  was 

because  they  understood  that  efficient  management  of  manpower  becomes  even  more 

critical  as  a  new  program  is  implemented  and  a  new  weapon  system  becomes  operational, 

and  furthennore  that  enhanced  supportability  depends  upon  efficient  and  effective 

resource  allocation.  The  research  specifically  addressed  the  impact  of  reliability  and 

maintainability  on  maintenance  manpower  requirements  and  mission  effectiveness 

(Akpinar,  1986). 
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How  the  Air  Force  Programs  and  Allocates  Manpower  to  Units 


Although  this  study  is  not  meant  to  analyze  how  manpower  is  “earned”  by  the 
various  QA  units  in  ACC,  having  a  basic  working  knowledge  of  the  AF  manpower 
system  is  essential  to  accepting  one  of  the  foundational  assumptions  that  the  study  is 
based  on.  Specifically,  this  study  assumes  that  each  QA  unit’s  UMD  consists  of  the 
correct  number  of  manpower  authorizations  required  for  the  mission  they  are  tasked  to 
perform.  What  follows  is  a  brief  overview  of  the  manpower  determination  process  (see 
Figure  7). 


Figure  7  -  Simplified  Block  Diagram  Tracing  Development  of  a  Valid  UMD 
At  the  highest  level,  the  AF  Directorate  of  Manpower,  Organization  and  Quality, 

Program  Development  Division  (HQ  USAF/XPMP)  allocates  programmed  manpower 

resources  to  the  commands  directing  implementation  of  approved  programs.  Next,  each 

command  translates  these  manpower  resources  into  manpower  authorizations  by 

notifying  the  respective  Manpower  Office.  The  local  Manpower  Office  notifies  the  unit 
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and  the  unit  is  responsible  to  input  the  data  to  the  manpower  office  to  update  the  Unit 
Manpower  Document  (UMD)  by  organization,  AFSC,  grade,  and  program  element  code. 
The  Manpower  and  Organization  Office  then  provides  this  detailed  identification  to  the 
respective  organization  and  the  personnel  community  (AFI  38-204). 

Basis  for  UMDs 

An  Air  Force  Manpower  Standard  (AFMS)  is  the  basis  for  all  AF  manpower 
requirements  and  AF  manpower  is  based  on  man-hour  requirements.  Man-hour 
requirements  are  further  detennined  in  one  of  three  ways,  all  of  which  are  rooted  in  a 
systematic  scientific  process.  The  two  most  often  used  for  Air  Combat  Command  (ACC) 
aircraft  maintenance/munitions  units  are  the  Logistics  Composite  Model  (LCOM)  and  the 
conventional  manpower  standard.  As  a  side  note,  each  ACC  base’s  Manpower  Office  is 
responsible  for  conducting  each  of  these  manpower  detenninant  processes  with  the 
approval  authority  running  from  AFMA  to  AF/XPMO  an  finally  to  AF/DPM  as  final 
approval  authority.  The  first  detenninant  process  uses  the  LCOM. 

The  LCOM  is  a  discrete-event  computer  simulation  used  to  model  manpower  and 
other  logistical  requirements  by  considering  employment  of  different  resources  to  help 
the  user  decide  the  best  mix  to  support  a  given  requirement.  Because  LCOM  studies  can 
identify  peacetime  and  wartime  requirements,  these  studies  provide  a  more  defensible 
budget  position  and  allow  for  effective  use  of  available  resources  (AFI  38-208,  Vol  3, 
para  1).  The  second  manpower  requirements  development  process  is  the  conventional 
manpower  standard.  The  conventional  manpower  standard  is  a  formula  based  on  aircraft 
type  and  mission  (e.g.  every  aircraft  squadron  equipped  with  24,  F-15Cs  tasked  with  an 
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air  superiority  mission  have  the  same  number  of  crew  chiefs,  avionics  technicians,  line 

expeditors,  etc  based  on  the  standard).  A  third  and  final  process  to  develop  manpower 

requirements  is  provided  for  in  AFI  38-210,  para  2.6.  The  instruction  states: 

Commands  may  determine  aircraft  maintenance  manpower  requirements  using 
aircraft  specific  maintenance  man-hour  per  flying  hour  (MMH/FH)  factors  when 
more  rigorous  methods  (conventional  manpower  standards  or  Logistics 
Composite  Model  manpower  determinants)  are  not  available  (AFI  38-210,  para 
2.6). 

Although  the  MMH/FH  process  is  also  computationally  grounded,  it  is  not  as 
rigorous  as  the  two  prior  methods.  The  MMH/FH  technique  uses  basic  standard 
weighted  formulas  for  different  sub-processes  within  the  AF  function  being  examined 
and  is  broken  down  by  Productive  Manning,  Addenda  (Survival  Shop,  Aerospace  Ground 
Equipment,  etc),  and  Additives  (Munitions,  Electronic  Countermeasures  Pods,  etc.). 
Again,  this  is  not  the  preferred  process  for  determining  manpower  requirements  (AFI  38- 
210,  para  2.6).  However,  whichever  of  the  three  processes  is  used,  they  all  result  in  a 
manpower  determinant,  and  this  determinant  may  ultimately  result  in  creation  of  a  UMD. 
Like  all  other  USAF  UMDs,  Air  Combat  Command  QA  UMDs  were  developed  using 
one  of  these  three  processes  (see  Table  2  for  an  example  of  a  UMD). 


Table  2  -  Unit  Manning  Document  (UMD)  Excerpt 
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Printed  On 

Unit  Manpower  Document 

Query:  MXG 

1/1/2005 

xxxxx 

OSC: 

MXQ  -  QUALITY  ASSURANCE 

FAC:  12345  -  QUALITY  ASSURANCE 

POS 

AFSC  and  TITLE 

SEI 

GRD 

RGR 

PEC 

1C 

01234567C 

ACFT  MAINTENANCE 

021  A3 

CAPT 

MAJOR 

AN 

1C 

01234567C 

AIRCRAFT  MGR 

2A300 

CMSGT  CMSGT 

AN 

1C 

01234567C 

AEROSPACE  MAI CRFTM 

2A571 

TSGT 

TSGT 

AN 

1C 

01234567C 

AEROSPC  PRP  CRFTMN 

2A671A 

TSGT 

TSGT 

AN 

1C 

01234567C 

NUCLEAR  WEP  CRFT 

2W271 

TSGT 

TSGT 

AN 

1C 

01234567C 

ACFT  ARM  SYS  JYMN 

2W151 

SSGT 

SSGT 

AN 

1C 

01234567C 

NUCLEAR  WEP  JYMN 

2W251 

SSGT 

SSGT 

AN 

1C 

01234567C 

NUCLEAR  WEP  JYMN 

2W251 

SSGT 

SSGT 

AN 

1C 

01234567C 

INFORMATION  JYMN 

3A051 

SSGT 

SSGT 

AN 

OSC: 

MXQ  -  QUALITY  ASSURANCE 

FAC: 

12345  -  QUALITY  ASSURANCE 

OSC: 

MXQ I  -  INSPECTION 

FAC:  12345-  QUALITY  ASSURANCE 

POS 

AFSC  and  TITLE 

SEI 

GRD 

RGR 

PEC 

1C 

01234567C 

AEROSPACE  MAI  SUPT 

2A590 

SMSGT 

SMSGT 

AN 

1C 

01234567C 

AEROSPACE  MAI  SUPT 

2A590 

SMSGT 

SMSGT 

AN 

1C 

01234567C 

AEROSPC  PRP  CRFTMN 

2A671A 

MSGT 

MSGT 

AN 

1C 

01234567C 

INTO  AVN  SYS/INS  CFM 

2A573B 

TSGT 

TSGT 

AN 

1C 

01234567C 

INTO  AVN  SYS  EW  CFTM 

2A573C 

TSGT 

TSGT 

AN 

1C 

01234567C 

AERO  GR  EQUIP  CRFT 

2A672 

TSGT 

MSGT 

AN 

1C 

01234567C 

ACF  EL/ENV  SYS  CRFT 

2A676 

TSGT 

TSGT 

AN 

1C 

01234567C 

MSL/SPC  SY  MA  CRFT 

2M071 

TSGT 

TSGT 

AN 

1C 

01234567C 

AEROSPACE  MAI  JYMN 

2A551K 

SSGT 

TSGT 

AN 

1C 

01234567C 

ACFT  HYDR  SYS  JYMN 

2A655 

SSGT 

SSGT 

AN 

1C 

01234567C 

ACFT  STRC  MAIN  JYMN 

2A753 

SSGT 

SSGT 

AN 

1C 

01234567C 

MUNITIONS  SYS  JYMN 

2W051 

SSGT 

SSGT 

AN 

1C 

01234567C 

ACFT  ARM  SYS  JYMN 

2W151 

SSGT 

SSGT 

AN 

OSC: 

MXQ  I  -  INSPECTION 

FAC: 

21A100  -  QUALITY  ASSURANCE 

Directives  Supporting  the  Requirement  for  AF  Maintenance  QA 

The  QA  UMD  is  the  result  of  a  manpower  determination.  As  such,  the  UMD  is 
the  legal  authorization  to  hire  and  pay  for  all  personnel  assigned  to  the  QA  flight,  to 
include  overhead  positions  (management  and  supervision),  all  inspector  positions,  the  AF 
Repair  Enhancement  shop,  and  the  administrative  function.  To  fully  understand  the 
requirements  that  the  UMD  was  created  to  support,  we  review  the  specific  functions  that 
QA  personnel  are  required  to  perfonn. 
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The  basic  requirement  for  a  QA  function  is  spelled  out  in  AFI  21-101  (para  10.2): 

•  Responsible  to  the  Maintenance  Group  (MXG)  Commander  to  perform  as  the 
primary  technical  advisory  agency  for  maintenance,  assisting  work  center 
supervisors 

The  following  is  the  remaining  list  of  other  QA  responsibilities  (AFI  21-101,  para  10.2): 

•  Implements  and  administers  the  Maintenance  Standardization  and  Evaluation 
Program  (MSEP) 

•  Manages  the  Product  Improvement  Program  (PIP) 

•  Manages  the  Deficiency  Reporting  (DR)  Program 

•  Manages  the  Product  Improvement  Working  Group  (PWIG) 

•  Manages  the  Reliability  and  Maintainability  (R&M)  Working  Group 

•  Manages  the  Technical  Order  Distribution  Office  (TODO) 

•  Manages  the  One-Time  Inspections  (OTI)  Program 

•  Manages  the  Functional  Check  Flight  (FCF)  Program 

•  Manages  the  Weight  and  Balance  (W&B)  Program 

•  Manages  the  Hot  Refuel  Program  (Hotpits) 

•  Manages  the  Aircraft  and  Equipment  Impoundment  Program 

•  Reviews  aircraft  aborts,  in-flight  emergencies  (IFE),  and  other  incidents  as 
required  using  MIS  or  MAJCOM forms 

•  Assists  Maintenance  Operations  Flight  (MOF)  Plans  Scheduling  and 
Documentation  (PS&D)  and  the  Munitions  Flight  with  the  Configuration 
Management  Program 
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•  Assists  MOF  PS&D  with  the  Time  Compliance  Technical  Order  (TCTO)  program 

•  Implements  the  unit  chafing  awareness  program 

•  QA  inspectors  augment  weapons  loading  inspection/evaluations  at  the  request  of 
Weapons  Standardization  Section 

•  QA  uses  their  technical  expertise  to  assist  the  MXG  to  arrive  at  informed 
decisions  when  coordinating  with  higher  headquarters,  AF  Materiel  Command, 
Defense  Contract  Maintenance  Agency,  and  other  outside  agencies 

•  Evaluates  unit  maintenance  management  procedures,  including  locally  developed 
forms,  publications,  operating  instructions,  etc,  for  accuracy,  intent,  and  necessity 

•  Ensures  management/evaluation  of  Special  Programs  listed  in  AFI 21-101, 
Chapter  18  as  assigned  by  the  MXG  Commander  (32  Special  Programs  listed) 

•  Manages  the  Air  Force  Repair  Enhancement  Program  (AFREP) 

Now  that  we  have  described  the  QA  construct,  we  investigate  the  literature  on 
maintenance  metrics. 

Examining  Maintenance-Related  Metrics 

In  the  USAF  Maintenance  Metrics  Handbook  forward  section.  Brigadier  General 

Terry  Gabreski,  Director  of  Logistics  for  the  Air  Force  Material  Command,  said: 

Metrics  are  critical  tools  to  be  used  by  maintenance  managers  to  gauge  an 
organization ’s  effectiveness  and  efficiency.  In  fact  they  are  roadmaps  that  let  you 
determine  where  vou ’ve  been,  where  vou  are  going,  and  how  (or  if)  vou  are  going 
to  get  there  (AFLMA,  2002). 

The  handbook  further  explained  that  metrics  are  not  just  charts  and  numbers  to  be  looked 
at,  but  are  rather  tools  for  fixing  problems.  Since  the  overarching  objective  of  AF 
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maintenance  is  to  maintain  aerospace  equipment  in  a  safe,  serviceable,  and  ready 
condition  to  meet  mission  needs,  maintenance  management  metrics  serve  this  objective 
(AFI  21-101,  para  10.1).  The  paragraph  further  states  that  metrics  shall  be  used  at  all 
levels  of  command  to  drive  improved  perfonnance  and  adhere  to  well  established 
guidelines  and  that: 

•  Metrics  must  be  accurate  and  useful  for  decision-making 

•  Metrics  must  be  consistent  and  clearly  linked  to  goals/standards 

•  Metrics  must  be  clearly  understood  and  communicated 

•  Metrics  must  be  based  on  a  measurable,  well-defined  process 

Metrics  —  Leading  and  Lagging 

The  instruction  also  delineated  that  primary  maintenance  metrics  are  grouped  into 
various  categories  with  the  two  more  important  categories  being  “leading”  and  “lagging” 
indicators.  The  leading  indicators  show  a  problem  first  because  they  directly  impact 
maintenance’s  capability  to  provide  resources  to  execute  the  mission,  whereas  lagging 
indicators  follow,  and  show  firmly  established  trends.  In  the  instruction,  those 
maintenance  metrics  that  the  Air  Force  considers  as  primary,  are  listed  in  alphabetical 
order  along  with  relevant  formulas  and  examples  (AFI  21-101,  para  1.10.3).  We 
address  these  formulas  again  in  Chapter  V. 

The  Air  Combat  Command  Flying  Wing  Structure 

An  average  Air  Combat  Command  (ACC)  flying  wing  contains  four  groups:  a 
Medical  Group  (Primary  Care,  Emergency,  Operations,  Mobility,  Flight  Medicine,  etc);  a 
Support  Group  (Security  Forces,  Civil  Engineer,  Base  Personnel  Office,  etc.);  an 
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Operations  Group  (pilots,  Life  Support,  Air  Space  Scheduling,  Air  Traffic  Control, 
Weather,  Flight  Records,  Intelligence,  Airfield  Operations,  etc.);  and  a  Maintenance 
Group  (Component  Maintenance,  Equipment  Maintenance,  Maintenance  Scheduling, 
Maintenance  Analysis,  Quality  Assurance,  Munitions,  End-of  Runway,  Maintenance 
Support,  etc.).  As  a  further  drill-down,  we  will  first  examine  the  functional  hierarchy 
Maintenance  Group  and  then  the  Quality  Assurance  sub-function. 

The  Air  Force  Maintenance  Group 

In  line  with  Air  Force  Instruction  (AFI)  21-101,  the  Maintenance  Group  is  primarily 
responsible  for  performing  organizational  level  (on-equipment)  and  intermediate  level 
(back  shop,  off-equipment)  maintenance.  This  effort  requires  many  personnel, 
performing  a  multitude  of  diverse  and  specialized  tasks  (see  Figure  8). 
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Figure  8  -  Maintenance  Group  Functional  Diagram 


More  specifically,  the  Maintenance  Group  Commander  is  “responsible  for 
aerospace  equipment  maintenance  required  to  ensure  balance  between  sortie  production 
and  fleet  management”  (AFI  21-101,  paragraph  2.3).  Although  this  may  sound  simplistic 
and  straightforward,  it  is  not.  In  fact,  this  research  uncovered  that  a  typical  ACC 
Maintenance  Group  is  comprised  of  between  2,500  and  3,500  maintenance  personnel. 
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Effectively  utilizing  this  number  of  diverse  personnel  in  itself  can  be  a  daunting 

leadership  and  management  challenge  but  add  to  this  the  high-stress  and  fast-paced 

element  that  comes  with  the  daily  training  and  combat  operations,  and  the  criticality 

factors  increase  exponentially.  This  is  where  the  Maintenance  Group  Commander  needs 

help  and  this  help  comes  in  the  form  of  a  highly  specialized  and  mature  workforce  of 

maintenance  personnel  who  are  hand-picked  to  form  the  Maintenance  group  Quality 

Assurance  Flight.  According  to  AFI  21-101,  paragraph  10.1: 

The  combined  efforts  of  quality  assurance  person  nel,  main  tenance  leaders,  and 
technicians  are  necessary  to  ensure  high-quality  maintenance  production  and 
equipment  reliability.  Maintenance  leaders  are  responsible  for  safety  of fight, 
safety  of  equipment  operation,  and  quality  maintenance  production.  The  quality 
assurance  staff  evaluates  the  quality  of  maintained  accomplished  in  the 
main  tenance  organization.  Quality  assurance  personnel  are  not  an  extension  of 
the  work  force.  Quality  assurance  serves  as  the  primary  technical  advisory 
agency  in  the  maintenance  organization,  helping  production  supervisors  and  the 
maintenance  group  commander  resolve  quality  problems.  The  evaluation  and 
analysis  of  deficiencies  and  problem  areas  are  key  functions  of  quality  assurance. 
This  activity  identifies  underlying  causes  of  poor  quality  in  the  maintenance 
production  effort.  By  finding  causes  of problems  and  recommending  corrective 
actions  to  supervisors,  quality  assurance  can  significantly  affect  the  quality  of 
maintenance  within  the  maintenance  complex. 

It  is  clear  from  the  governing  direction  how  highly  regarded  the  aircraft 
maintenance  quality  assurance  function  is.  Now,  taking  into  account  the  huge  number  of 
activities  and  personnel  that  need  this  critical  quality  assurance  oversight,  it  would  seem 
to  require  a  flight  of  hundreds  to  perform  this  job;  however,  this  is  not  the  reality.  In  fact, 
the  average  ACC  quality  assurance  flight  contains  25  to  30  personnel  including  overhead. 
This  equates  to  an  approximate  100-to-l  ratio  of  maintainers  to  “assigned”  QA  inspectors 
within  a  typical  aircraft  wing’s  Maintenance  Group  (this  includes  both  flight  line, 
maintenance  shops,  and  munitions  storage  area  personnel.  It  further  indicates  a  fully- 
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staffed  QA  shop  with  no  one  on  leave,  deployed,  in  training,  etc).  Furthermore,  when  the 
QA  shop’s  management  and  administrative  overhead  is  factored  out  and  actual  shift¬ 
manning  is  broken  down,  an  effectively  scheduled  QA  shop  might  be  able  to  muster  five 
inspectors  per  10-hour  work  shift.  Coupled  to  this  is  the  fact  that  these  “golden  five”  are 
charged  with  a  multitude  of  duties  including  providing  maintenance  oversight,  and 
performing  safety  and  technical  investigations  along  with  task  certification  for  trainees  in 
upgrade  status.  They  perfonn  these  duties  all  while  covering  day-to-day  contracted  task 
evaluations.  Because  of  this  low  ratio  of  critical  QA  troops  to  maintenance  personnel,  it 
is  absolutely  essential  that  the  “right”  people  be  assigned. 

Chapter  Overview  and  Conclusion 

In  this  chapter  we  provided  an  overview  of  the  relevant  literature.  In  Chapter  III, 
we  examine  the  methodology  used  in  the  study. 
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III.  Methodology 


Overview 

In  this  chapter,  we  present  the  methodology  followed.  We  first  present  the 
research  question  and  investigative  questions. 

The  Research  Question 

This  research  seeks  to  answer  the  question:  What  effect  does  mismatching  Air 
Force  Specialty  Codes  (AFSC)  or  leaving  unit  manpower  document  (UMD)  authorized 
manpower  positions  unfilled  in  aircraft  maintenance  QA  units  have  on  key  unit-  and/or 
wing-level  measures? 

The  Investigative  Questions 

Multiple  questions  were  addressed  in  order  to  answer  the  research  question: 

1)  Which  key  unit-  and  wing-level  metrics  are  most  affected  by  an  empty  QA 
manning  position  or  a  mismatch? 

2)  What  is  the  effectiveness  of  a  person  without  the  UMD-designated  AFSC  when 
performing  the  QA  duties  of  another  AFSC  (how  good  is  the  “fit”)? 

3)  What  is  the  relationship  between  QA  manning  effectiveness  and  key  unit-  and 
wing-level  metrics? 

Analytical  Model 

This  study  was  completed  in  four  distinct  phases  directly  linked  to  the  three 
investigative  questions  (see  Figure  9).  Phase-One  was  comprised  of  a  two-part  Delphi 
survey  sent  out  to  senior  aircraft  maintenance  managers,  leaders,  and  subject  matter 
experts  across  Air  Combat  Command  (ACC)  aircraft/maintenance  units.  In  this  phase, 
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key  maintenance  metrics  were  identified  and  a  manning  effectiveness  matrix  was 
constructed.  Phase-Two  of  the  study  consisted  of  acquiring  all  ACC  aircraft  flying  units’ 
historical  manning  and  applying  the  manning  effectiveness  matrix  to  this  data.  In  Phase- 
Three,  the  subject  aircraft  flying  units’  key  unit-  and  wing-level  metrics  were  compiled 
and  statistically  regressed  against  the  calculated  QA  manning  effectiveness  rates.  We 
then  analyzed  the  regression  analysis  results  in  Phase-Four  in  order  to  develop  potential 
mitigating  strategies  for  use  by  mid-level  Air  Force  aircraft/munitions  maintenance 
managers.  Using  the  data,  we  also  performed  a  sample  benefit-cost  analysis.  The  four 
phases  are  examined  in  detail  in  chapters  III  through  V,  but  first  we  will  overview  the 
primary  research  tool  used  to  garner  information  to  complete  Phase  One  of  the  study. 


Phase-1:  Perform  2-Part  Delphi 
Survey  then  use  the  results  to 
develop:  (1)  a  Candidate  List  of 
Metrics,  and  (2)  the  Substitute 
AFSC  Effectiveness  Matrix 
(AFSC-MEM) 


Phase-4:  Analyze  the  regression 
analysis  results  for  correlation 
between  unit  QA  historical 
manning  effectiveness  and  key 
unit-  and  wing-level  metrics; 
perform  a  benefit-cost  analysis; 
report  the  findings 


Phase-2:  Retrieve  historical  QA 
manning  for  all  ACC  aircraft 
units  and  then  use  the  “AFSC- 
MEM”  to  calculate  an  overall  QA 
Manpower  Effectiveness  for  each 
of  16  ACC  bases,  by  month 


Phase  -3:  Retrieve  historical 
metric  data  indicated  by  SMEs  in 
Phase- 1  then  perform  a  time- 
series  regression  between  the 
calculated  QA  manning 
effectiveness,  and  each  metric  for 
all  16  ACC  bases 


Figure  9  -  Flow  Diagram  of  Four-Phase  Research  Process 


The  Delphi  Technique 


The  Delphi  technique  was  chosen  for  Phase-One  due  to  its  relative  strength  of 
application  compared  to  the  requirements  of  the  study.  In  essence,  the  objective  of 
Phase-One  of  the  study  was  to  develop  a  useful  worker  effectiveness  rating  scale  for  a 
person  with  a  particular  skill  set  when  performing  the  duties  of  a  job  different  from  what 


30 


they  are  specifically  trained  for  and  to  elicit  the  metrics.  The  Delphi  technique  provided 
a  natural  fit  to  gain  this  type  of  knowledge. 

Delphi  Technique  -  Some  Uses 

According  to  Linstone,  Harold  A.  and  Murray  Turoff,  the  Delphi  technique  is 
often  used  to  combine  and  refine  the  opinions  of  a  heterogeneous  group  of  experts  in 
order  to  establish  a  judgment  based  on  merging  of  the  information  collectively  available 
to  the  experts  (see  Figure  10).  Further,  a  Delphi  can  be  characterized  as  a  method  for 
structuring  a  group  communication  process  so  that  the  process  is  effective  in  allowing  a 
group  of  individuals,  as  a  whole,  to  deal  with  a  complex  problem.  The  Delphi  Method  is 
a  group-making  technique  developed  as  part  of  an  Air  Force-sponsored  RAND 
Corporation  study  in  the  early  1950’s.  The  Delphi  Method  seeks  to  achieve  consensus 
among  group  members  through  a  series  of  questionnaires.  The  questionnaires  are 
answered  anonymously  and  individually  by  each  member  of  the  group.  The  answers  are 
summarized  and  sent  back  to  the  group  members  along  with  the  next  questionnaire.  The 
process  is  repeated  until  a  group  consensus  is  reached  within  a  bounds  determined  a 
priori.  This  usually  only  takes  two  iterations,  but  can  sometimes  take  as  many  as  six 
rounds  before  a  consensus  is  reached  (Linstone,  Harold  A.  and  Murray  Turoff,  ed,  1975). 


Figure  10  -  Delphi  Method  Flow  Diagram 
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The  Delphi  Technique  has  proven  to  have  many  uses  among  which  are: 


1)  Gathering  current  and  historical  data  not  accurately  known  or  available 

2)  Examining  the  significance  of  historical  events 

3)  Evaluating  possible  budget  allocations 

4)  Exploring  urban  and  regional  planning  options 

5)  Planning  university  campus  and  curriculum  development 

6)  Putting  together  the  structure  of  a  model 

7)  Delineating  the  pro  and  cons  associated  with  potential  policy  options 

8)  Developing  casual  relationships  in  complex  economics  or  social  phenomena 

9)  Distinguishing  and  clarifying  real  and  perceived  human  motivations 

10)  Exposing  priorities  of  personal  values,  social  goals  ”  (Turoff  and  Linstone,  1975) 

This  study  takes  advantage  of ‘uses  1,  6,  8  and  10’  from  the  preceding  list. 

Delphi  Technique  -  Properties  Supporting  Its  Use 

It  is  not  the  explicit  nature  of  the  applications  which  determines  the 
appropriateness  of  utilizing  Delphi;  it  is  the  particular  circumstances  surrounding  the 
necessarily  associated  group  communication  process:  Who  is  it  that  should  communicate 
about  the  problem,  what  alternative  mechanisms  are  available  for  that  communication, 
and  what  can  we  expect  to  obtain  with  these  alternatives?  When  these  questions  are 
addressed,  one  can  decide  if  the  Delphi  is  the  desirable  choice.  Usually  one  or  more  of 
the  following  properties  of  the  application  leads  to  the  need  for  employing  Delphi: 

1)  The  problem  does  not  lend  itself  to  precise  analytical  techniques  but  can  benefit 
from  subjective  judgment  on  a  collective  basis. 

2)  The  individuals  needed  to  contribute  to  the  examination  of  a  broad  or  complex 
problem  have  no  history  of  adequate  communication  and  may  represent  diverse 
backgrounds  with  respect  to  experience  or  expertise. 

3)  More  individuals  are  needed  that  can  effectively  interact  in  a  face-to-face 
exchange. 

4)  Time  and  cost  make  frequen  t  group  meetings  infeasible. 

5)  The  efficiency  of  face-to-face  meetings  can  be  increased  by  a  supplemental  group 
communication  process. 

6)  Disagreements  among  individuals  are  so  severe  or  politically  unpalatable  that  the 
communication  process  must  be  refereed  or  anonymity  assured. 


32 


7)  The  heterogeneity  of  the  participants  must  be  preserved  to  assured  validity  of  the 
results  i.e.  avoidance  of  domination  by  quantity  or  by  strength  of personality 
(bandwagon  effect)  (Turoff  and  Linstone,  1975). 

This  study  encompasses  all  of  the  preceding  Delphi  technique  properties  except  #6. 

Delphi  Technique  -  Potential  Problems  When  Using 

There  are  potential  problems  with  utilizing  the  Delphi  Technique  which  must  be 
mitigated  for,  if  the  process  is  expected  to  be  effective.  Some  of  these  are: 

1)  Imposing  the  monitor ’s  views  and  preconceptions  upon  the  respondent  group  by 
over  specifying  the  structure  of  the  Delphi  and  not  allowing  for  the  contribution 
of  other  perspectives  related  to  the  problem. 

2)  Assuming  that  the  Delphi  can  be  a  surrogate  for  all  other  human  communications 
in  a  given  situation. 

3)  Poor  techniques  of  summarizing  and  preventing  the  group  response  and  ensuring 
common  interpretations  of  the  evaluation  scales  utilized  in  the  exercise. 

4)  Ignoring  and  not  exploring  disagreements,  so  that  the  discouraged  dissenters 
drop  out  and  an  artificial  consensus  is  generated. 

5)  Underestimating  the  demanding  nature  of  the  Delphi  and  the  fact  that  the 
respondents  should  be  recognized  as  consultants  and  properly  compensated  for 
their  time  if  the  Delphi  is  not  an  integral  part  of  their  job  function  (Turoff  and 
Linstone,  1975). 

All  of  these  potential  problems  were  applicable  to  Phase-One  of  this  study. 

Delphi  Technique  -  How  to  Choose  a  Good  Respondent  Group 
A  typical  concern  when  performing  the  Delphi  Technique  is  how  to  choose  a 
good  respondent  group  in  both  composition  and  in  number.  Not  only  should  the 
respondents  be  volunteers  but  they  should  also  be  subject  matter  experts  who  will  be  able 
to  participate  in  the  entire  Delphi  process.  This  was  a  problem  during  this  study  and  it 
will  be  discussed  along  with  mitigating  strategies  undertaken  to  account  for  this.  But,  the 
basic  question  remains:  Just  how  many  respondents  does  it  take  to  make  a  good 
respondent  group?  Experiments  by  Brockhoff  (1975)  suggest  that  under  ideal 
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circumstances,  groups  as  small  as  four  can  perform  well  (Dalkey,  1969).  However,  like 
in  most  research  studies,  more  data  is  better.  This  study  is  no  exception. 

To  determine  the  correct  group  size  for  our  Delphi  panel,  we  looked  to  the  1969 
study  performed  for  the  USAF  by  the  RAND  Corporation,  the  creator  of  the  Delphi 
Method.  In  the  study,  RAND  performed  an  experiment  designed  to  measure  the 
correlation  between  the  effect  of  group  size  and  average  group  error.  The  results  of  this 
experiment  are  charted  in  Figure  1 1  which  clearly  shows  that  the  mean  accuracy  of  a 
group  response  for  a  large  set  of  experimentally  derived  answers  to  factual  questions, 
increases  as  group  size  increases  (Dalkey,  1969). 


1  5  7  9  11  13  15  17  19  21  23  25  27  29 

Number  in  Group 

Figure  1 1  -  Effect  of  Group  Size  on  Error  (Dalkey,  1969) 

Specifically,  with  smaller  group  sizes  of  between  one  and  seven  persons,  the 
average  group  error  rate  behaves  exponentially  then  begins  to  flatten  out  as  the  group  size 
approaches  15.  Also  according  to  the  RAND  report,  reliability  of  responses  increases  on 
a  linear  path  as  the  group  size  increases  from  three  to  1 1  panelists  (see  Figure  12). 
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RELIABILITY  VS  GROUP  SIZE 


Figure  12  -  Effect  of  Group  Size  on  Reliability  (Dalkey,  1969) 

Furthermore,  according  to  Ludwid,  the  majority  of  Delphi  studies  have  used 
between  15  and  20 panelists,  but  Dalkey,  Rourke,  Lewis,  and  Snyder  (1972)  reported  a 
definite  and  monolithic  increase  in  group  response  approaching  a  correlation  coefficient 
of  0.9  with  a  group  size  of  13  respondents  (Ludwid,  1997).  Thus,  this  empirical  data 
gives  us  an  initial  target  number  of  qualified  panelists  for  Phase-One  of  the  study.  Based 
on  this  research,  we  set  a  minimum  requirement  of  a  2:1  ratio  of  qualified  group  members 
to  actual  units  under  study.  This  gave  us  a  required  starting  size  of  24  panelists  (14  ACC 
units  x  2)  which  we  easily  surpassed  with  45  actual  volunteers  at  the  beginning  of  the 
study.  This  correlated  well  with  Clayton’s  rule-of-thumb  that  15-30  people  is  an 
adequate  panel  size  (Clayton,  1997).  At  the  end  of  this  chapter  we  will  address  some 
problems  associated  with  self-reports  in  the  Scope  and  Limitations  section.  We  will  now 
examine  Phase-One  of  our  methodology. 
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Phase-One  of  the  Study 


Obtaining  the  ACC  Aircraft  QA  AFSC  List  of  Manpower  Positions 

Phase-One  began  with  the  researcher  contacting  ACC/LGQ  which  is  the 
headquarters  function  for  ACC  quality  assurance  units.  Specifically,  the  ACC/LGQ 
superintendent  provided  two  spreadsheets  containing  the  most  current  list  of  QA  and 
Maintenance  Group  leadership  contacts  for  all  ACC  aircraft  flying  units  (QA  flight 
commanders,  chiefs,  and  superintendents,  and  maintenance  group  chiefs).  We  used  this 
list  to  initiate  contact  with  each  of  the  units  to  ask  them  if  they  would  provide  us  a  list  of 
all  of  their  Unit  Manning  Document  (UMD)  authorized  manpower  positions  for  their 
maintenance  QA  flight.  Furthermore,  to  help  standardize  the  responses,  we  then  created 
and  sent  each  of  the  units  a  spreadsheet  for  them  to  fill  in  and  send  back  their  UMD- 
authorized  manning. 

Each  of  the  units  subsequently  provided  the  file  that  contained  all  of  their  UMD- 
authorized  manpower  positions  broken  down  to  the  Air  Force  Specialty  Code  (AFSC) 
skill-level  and  shred-out  detail  (i.e.  the  C  in  AFSC  2A551C  indicates  a  B-52  technician). 
These  original  unit  UMDs  were  then  aggregated  by  AFSC,  and  skill  level  to  develop  a 
master  ACC  aircraft  quality  assurance  AFSC  list.  The  resultant  list  contained  65 
different  AFSCs  delineated  by  skill-level  and  shred  out  that  would  be  used  to  create  a 
square  matrix  for  the  next  sub-phase  of  the  study.  However,  a  list  this  large  would  result 
in  a  survey  questionnaire  with  4,225  AFSC  effectiveness  combinations  for  the  research 
respondents  to  subjectively  grade  (65  =  4,225).  A  survey  this  large  was  deemed 
intractable  (see  Table  3). 
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Table  3  -  Initial  ACC  Aircraft  QA  AFSC  List  of  Manpower  Positions 


AFSC 

AFS  TITLE 

AFSC 

AFS  TITLE 

2A551L 

. .  m 

2A553A 

mmnmiMimmmmmmMmmmmM 

.  — i 

2A571 

INTEGRATED  AVIONICS  SYSTEMS  ELECTRONIC  WARFARE  CRAFTSMAN 

2A571L 

mmmm m 

mmmmmmmsmmmmmm 

2A573 

liBgniraM— — 

2A651A 

2A655 

2A671A 

mmmmimmmmMmmammm 

AIRCRAFT  ELECTRICAL/ENVIRONMENTAL  SYSTEM  CRAFTSMAN 

AIRCRAFT  ELECTRICAL/ENVIRONMENTAL  SYSTEMS  JOURNEYMAN 

ENGINE  MANAGER 

AIRCRAFT  MAINTENANCE  OFFICER 

2A051A 

AIRCRAFT  EGRESS  SYSTEMS  CRAFTSMAN 

2A071A 

AVIONICS  TEST  STATION  &  COMPUTER  CRAFTSMAN 

AIRCRAFT  FUEL  SYSTEMS  CRAFTSMAN 

AVIONICS  TEST  STATION  k  COMPUTER  CRAFTSMAN 

AIRCRAFT  HYDRAULICS  SYSTEMS  CRAFTSMAN 

TACTICAL  AIRCRAFT  SUPERINTENDENT 

AIRCRAFT  ELECTRICAL/ENVIRONMENTAL  SYSTEMS  CRAFTSMAN 

2A351A 

2A352 

mm 

2A753 

2A353A 

TACTICAL  AIRCRAFT  MAINTENANCE  F-15  JOURNEYMAN 

2A754 

TACTICAL  MAINTENANCE  F-16/F-117  JOURNEYMAN 

2A773 

AIRCRAFT  STRUCTURAL  MAINTENANCE  CRAFTSMAN 

2A353J 

TACTICAL  AIRCRAFT  MAINTENANCE  GENERAL  JOURNEYMAN 

2A774 

BBBB 

2A371 

2E171 

SATELLITE,  WIDEBAND,  &  TELEMETRY  SYSTEMS  CRAFTSMAN 

2A372 

F16/F117/R21/CV22  AVIONICS  CRAFTSMAN 

2E271 

. .  ■■Hill 

2A373 

TACTICAL  AIRCRAFT  MAINTENANCE  CRAFTSMAN 

2A373A 

TACTICAL  AIRCRAFT  MAINTENANCE  CRAFTSMAN 

m 

TACTICAL  AIRCRAFT  MAINTENANCE  CRAFTSMAN 

iwiii 

TACTICAL  AIRCRAFT  SUPERINTENDENT 

2A551J 

2W171 

mmmmMmmmmmmmm m 

2A551K 

MMmmmmMmmmmmmmM 

2W251 

rai 

roi 

2A553C 

2A572 

Functionally  Shaping  the  ACC  Aircraft  QA  AFSC  List  of  Manpower  Positions 
To  functionally  shape  the  AFSC  effectiveness  grading  matrix,  we  needed  to  pare 
down  the  candidate  list  of  AFSCs  to  a  more  manageable  number.  First,  all  AFSCs  not 
relevant  to  the  QA  inspection  process  (functional  check  flight  pilot,  maintenance  officer, 
and  administrative  positions)  were  eliminated.  We  then  aggregated  all  AFSCs 
functionally  by  combining  the  five-  and  seven-skill  levels  (Technician  and  Craftsman 


37 


respectively)  for  each  AFS  (AF  Specialty)  and  nine-  and  zero-skill  level  (Superintendent 
and  Chief  Master  Sergeant  Chief  Enlisted  Manager  Code)  within  each  AFS.  This 
decreased  the  master  ACC  aircraft  QA  AFSC  list  to  47  different  AFSCs  which  equated  to 
2,209  individual  AFSC  effectiveness  combinations  for  the  first  sub-phase  (47"  2,209). 
This  was  also  detennined  to  be  unmanageable.  To  further  decrease  the  number  of  AFSCs 
on  the  list,  AFSC  shredouts  (identifies  special  weapons  systems  or  skills  required  for  a 
position)  were  eliminated  to  standardize  AFSCs.  This  last  cut  created  a  master  ACC 
aircraft  quality  assurance  AFSC  list  of  24  different  AFSCs  for  a  sub-phase  count  of  570 
individual  AFSC  effectiveness  combinations  (24  570).  Although  still  a  large  number, 

we  detennined  that  any  further  aggregation  would  result  in  too  broad  of  categories  to 
effectively  work  with  (see  Table  4). 


Table  4  -  Resultant  ACC  Aircraft  QA  AFSC  List  of  Manpower  Positions 


AFSC 

AFS  TITLE 

2A0X1 

AVIONICS  TEST  STATION  AND  COMPUTER  JOURNEYMAN/CRAFTSMAN 

2A3X0 

TACTICAL  AIRCRAFT  SUPERINTENDENT 

2A3X1 

A10/F15/U2  AVIONICS  ATTACK  JOURNEYMAN/CRAFTSMAN 

2A3X2 

A10/F15/U2  AVIONICS  ATTACK  JOURNEYMAN/CRAFTSMAN 

2A3X3 

TACTICAL  AIRCRAFT  MAINTENANCE  F-15  JOURNEYMAN/CRAFTSMAN 

2A590 

MAINTENANCE  SUPERINTENDENT  (NON-TACT1CAL  AIRCRAFT) 

2A5X1 

AEROSPACE  MAINTENANCE  JOURNEYMAN/CRAFTSMAN 

2A5X2 

HELICOPTER  MAINTENANCE  JOURNEYMAN/CRAFTSMAN 

2A5X3 

INTEGRATED  AVIONICS  SYSTEMS/INS  JOURNEYMAN/CRAFTSMAN 

2A6X0 

AIRCRAFT  SYSTEMS  MANAGER 

2A6X1 

AEROSPACE  PROPULSION  JOURNEYMAN/CRAFTSMAN 

2A6X2 

AEROSPACE  GROUND  EQUIPMENT  JOURNEYMAN/CRAFTSMAN 

2A6X3 

AIRCRAFT  EGRESS  SYSTEMS  JOURNEYMAN/CRAFTSMAN 

2  A  6X4 

AIRCRAFT  FUEL  SYSTEMS  JOURNEYMAN/CRAFTSMAN 

2A6X5 

AIRCRAFT  HYDRAULICS  SYSTEMS  JOURNEYMAN/CRAFTSMAN 

2A6X6 

AIRCRAFT  ELECTRICAL/ENVIRONMENTAL  SYSTEMS  JOURNEYMAN/CRAFTSMAN 

2A7X3 

AIRCRAFT  STRUCTURAL  MAINTENANCE  JOURNEYMAN/CRAFTSMAN 

2A7X4 

SURVIVAL  EQUIPMENT  JOURNEYMAN/CRAFTSMAN 

2E1X1 

SATELLITE,  WIDEBAND,  &  TELEMETRY  SYSTEMS  JOURNEYMAN/CRAFTSMAN 

2E2X1 

COMPUTER  NETWORK  S&C  SYSTEMS  JOURNEYMAN/CRAFTSMAN 

2M0X1 

M1SSILE/SPC  SYSTEMS  MAINTENANCE  JOURNEYMAN/CRAFTSMAN 

2W0X1 

MUNITIONS  SYSTEMS  JOURNEYMAN/CRAFTSMAN 

2W1X1 

AIRCRAFT  ARMAMENT  SYSTEMS  JOURNEYMAN/CRAFTSMAN 

2W2X1 

NUCLEAR  WEAPONS  JOURNEYMAN/CRAFTSMAN 
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The  derived  master  ACC  aircraft  maintenance  QA  AFSC  list  was  then  sent  to 
each  of  the  ACC  aircraft  maintenance  QA  units  to  validate  that  it  did  in  fact  contain  all  of 
their  authorized  AFSCs  at  the  aggregate  level.  All  ACC  aircraft  QA  units  responded 
affirmatively  and  we  determined  the  master  list  to  be  acceptable.  This  ACC  aircraft  QA 
AFSC  master  list  containing  the  24  aggregated  AFSCs  was  then  used  to  develop  a  cross¬ 
combination  grading  matrix  and  a  web-based  survey  (see  Appendix  A). 

Composing  the  Delphi  Panel  of  Experts 

To  gain  a  list  of  potential  survey  respondents  with  the  required  background  to 
participate  as  qualified  members  of  the  Delphi  Panel  of  Experts,  a  list  of  QA  and 
maintenance  group  leaders  obtained  from  ACC/LGQ  was  used  as  a  seed  to  send  out  the 
request  for  volunteers.  The  rationale  for  this  is  that  these  personnel,  due  to  their  position, 
were  considered  good  candidates  as  subject  matter  experts  on  the  aircraft  maintenance 
and  quality  assurance  functions  under  study.  The  researcher  then  sent  out  a  focused  call 
to  each  of  these  personnel  via  e-mail  asking  for  volunteers. 

To  further  ensure  a  representative  view  across  all  ACC  aircraft  maintenance  units, 
a  basic  objective  was  set  to  attain  a  minimum  of  two  senior  leaders  from  each  unit  to 
participate  on  the  Delphi  panel  of  experts.  Also,  each  of  the  potential  respondents  was 
vetted  to  ensure  they  possessed  a  minimum  of  six  years  of  experience  in  the  aircraft 
maintenance  field.  Respondents  who  did  not  meet  this  requirement  were  not  used  on  the 
Delphi  panel  of  experts  for  the  two-part  surveys.  The  demographics  of  the  volunteers 
who  were  ultimately  accepted  for  the  panel  appear  in  Table  5. 
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Table  5  -  Del] 

ohi  Panel  of  Experts  Demographic  Data  -  Initial  List 

Initial  Group 

Rank 

Number  in  Rank 

Average  Number  Years 
Aircraft/Munitions  Maintenance 
Experience 

Lt  Colonel 

2 

22 

Major 

2 

12 

Captain 

3 

9 

CMSqt 

28 

24 

SMSqt 

10 

18 

Totals 

45 

21.0 

The  Two-Part  Survey  Using  the  DELPH  Technique 

Survey,  Part-1 

A  two-part,  web-based  survey  was  developed  to  send  out  to  the  Delphi  panel  of 
experts.  The  specific  objective  in  Survey,  Part-1,  was  to  answer  the  Investigative 
Question:  “Which  key  unit-  and  wing-level  metrics  are  most  affected  by  an  empty  QA 
manning  position  or  a  mismatch?”  It  was  designed  to  elicit  a  cognitive  view  from  experts 
in  the  aircraft  maintenance  field  on  how  they  saw  the  impact  that  they  perceived  the 
aircraft/munitions  quality  assurance  function  had  on  a  candidate  list  of  the  more  visible 
wing-  and  unit-level  metrics  as  detennined  by  the  researcher.  Survey,  Part-l’s 
instructions  asked  the  respondents  to  rate  each  of  fifteen  candidate  metrics  on  a  six-point 
LIKERT  scale  from  Strongly  Disagree  to  Strongly  Agree  (see  Table  6  and  Appendix  A). 
The  respondents  were  also  encouraged  to  provide  additional  metrics  they  felt  were 
impacted  by  the  performance  of  the  quality  assurance  function.  Each  question  also 
included  an  area  for  the  respondents  to  comment  on  their  ratings  if  they  so  desired. 

It  should  be  noted  that  we  chose  to  use  a  six-point  LIKERT  scale  without  a  neutral  option 
in  order  to  eliminate  fence-sitting  and  to  “force”  an  answer.  Additionally,  we  performed 
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only  one  round  of  Survey,  Part- 1  because  the  basic  intent  of  this  sub-phase  was  to  gain  a 
candidate  list  of  metrics  to  use  in  Phase-Three  of  the  study.  Both  of  these  decisions 
supported  this  objective. 


Table  6  -  Survey,  Part-1  Rating  Scale 


Rating  Scale 

Descriptor 

Rating 

%  Effect 

Strongly  Disagree 

1 

0% 

Disagree 

2 

20% 

Somewhat  Disagree 

3 

40% 

Somewhat  Agree 

4 

60% 

Agree 

5 

80% 

Strongly  Agree 

6 

1 00% 

As  a  quality  control  measure  and  to  uncover  problems  and/or  inconsistencies,  the 
survey  instrument  was  first  Beta-tested  on  seven  Air  Force  Institute  of  Technology 
students  who  possessed  extensive  aircraft  maintenance  experience  (greater  than  six  years 
each).  Once  all  reported  problems  were  corrected,  the  survey  instrument  was  vetted  once 
again  through  the  thesis  committee  where  two  more  problems  were  highlighted  and 
subsequently  corrected.  Afterward,  the  instrument  was  released  to  the  Air  Force  Institute 
of  Technology’s  production  server  and  then  the  web  link  was  sent  out  to  the  Delphi 
panelists.  Table  7  contains  demographic  data  for  the  Survey,  Part-1  respondents.  Table  8 
is  a  combined  list  of  metrics  submitted  by  the  Delphi  panel  while  Appendixes  BU  and 
BY  show  response  values  along  with  validation  determinations  for  each  metric. 
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Table  7  -  Survey,  Part-2  ROUND  ONE  Panel  of  Experts  Demographic  Data 


Survey,  Part  -1 

Rank 

Number 

Average  Number  Years 
Aircraft/Munitions  Maintenance 
Experience 

Lt  Colonel 

1 

18 

Major 

2 

12 

Captain 

2 

9 

CMSqt 

22 

22.6 

SMSqt 

7 

18 

Totals 

34 

20.1 

Table  8  -  Survey,  Part-1  Metrics  Validated  /  Not  Validated 

_ Validated  Metrics  (>50%) _ 

Abort  Rate 
Break  Rate 
CAXN7  Rate 

Dropped  Object  Counts _ 

Deficiency  Reports  Submitted 
Detected  Safety  Violations 

Fix  Rates _ 

Flight  Mishap  Counts _ 

Foreign  Object  Damage  Counts 

Flying  Schedule  Effectiveness  Rates _ 

Ground  Alishap  Counts _ 

In-Flight  Emergency  Rates _ 

Key  Task  List  Pa  ss  Rates 
Xlission  Capable  Rates 

Maintenance  Scheduling  Effectiveness  Rates _ 

Maintenancc/Operations  Deviations  Counts _ 

Personnel  Evaluation  Pass  Rates 
Pha  se  Key  Task  List  Pass  Rates 

Quality  Verification  Inspection  Pass  Rates _ 

Recur  Rates _ 

Repeat  Rates 

Safety/Technical  Violation  Counts 

Technical  Data  Violation  Counts _ 

Total  Non-Mission  Capable  Rates _ 

T.O.  Improvements  Submitted  Counts 


_ Mot  Validated  Metrics  (<50%) 

Cut  Tires _ 

Hung  Ordnance  Rate _ 

Late  Takeoff  Rate 
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Survey,  Part-2  -  ROUND  ONE 

Survey,  Part-2  was  created  to  answer  the  Investigative  Question:  “What  is  the 
effectiveness  of  a  person  without  the  UMD-designated  AFSC  when  perfonning  the  QA 
duties  of  another  AFSC  (how  good  is  the  ‘fit’)?”  For  ROUND  ONE  of  Survey,  Part-2,  a 
web-based  instrument  was  developed  and  sent  out  to  all  Delphi  Panel  of  Experts 
members.  It  consisted  of  a  28-page  survey  containing  one  introduction  page,  one 
instructions  page,  one  demographics  page,  24  survey  sheets,  and  one  closure  page.  The 
heart  of  Survey,  Part-2  was  the  24  AFSC  effectiveness  grading  sheets. 

As  a  quality  control  measure  and  to  uncover  problems  and/or  inconsistencies,  the 
survey  instrument  was  first  Beta-tested  on  seven  Air  Force  Institute  of  Technology 
students  who  possessed  extensive  aircraft  maintenance  experience  (i.e.  greater  than  six 
years  each).  Once  all  reported  problems  were  corrected,  the  survey  instrument  was 
vetted  once  again  through  the  thesis  committee  where  four  more  problems  were 
highlighted  and  subsequently  corrected.  The  instrument  was  then  released  to  the  Air 
Force  Institute  of  Technology’s  production  server  and  afterward  the  link  was  sent  out  to 
the  Delphi  panel  of  experts. 

Each  Delphi  panelist  was  asked  to  systematically  rate,  on  a  scale  of  one  to  five 
(correlating  to  a  scale  of  0  to  100  percent  in  20-point  increments),  how  effective  a  person 
possessing  the  AFSC  in  each  row  appearing  down  the  left  column  on  each  page  could  be 
expected  to  perfonn  the  duties  and  tasks  of  the  QA  manning  position  listed  on  the  top  of 
each  sheet.  It  was  expressly  explained  in  the  instructions  to  the  respondents  that  they 
were  to  rate  the  effectiveness  of  an  average  person  possessing  each  designated  AFSC 
performing  QA  duties,  not  the  normal  flight  line  or  back  shop  maintenance  tasks 
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performed  by  technicians.  Once  all  ROUND  ONE  responses  were  received  from  the 
panel  members,  they  were  compiled,  aggregated,  and  statistically  averaged. 

Because  the  Delphi  panel  consisted  of  high-ranking  and  critically-placed 
maintainers  and  leaders,  their  ability  to  dedicate  two  to  three  hours  to  a  survey  became  a 
problem  for  many  of  them  and  thus,  Survey,  Part-2  ROUND  ONE  took  over  three 
months  to  complete.  Furthermore,  although  a  comments  section  was  provided  for  on  this 
part  of  the  web-based  survey,  there  were  no  comments  provided  from  the  panel.  Based 
on  e-mail  and  phone  responses  from  panelists,  it  was  concluded  that  this  was  caused  by 
two  phenomena:  the  first  cause  for  a  lack  of  comments  on  ROUND  ONE  was  that  the 
survey  fostered  this  type  of  response  due  to  its  length  (requiring  570  individual 
responses)  even  though  the  survey  enabled  the  panel  member  to  stop  and  start  again  later 
where  they  left  off.  The  second  causal  factor  for  getting  no  comments  back  was  that  the 
questions  asked  for  the  respondents  to  rate  manning  effectiveness  based  on  experience. 
With  the  high  caliber  of  individuals  on  the  panel  and  the  straightforwardness  of  the 
survey  instrument,  it  is  understandable  that  the  panelists  detennined  that  they  did  not 
need  to  defend  an  opinion  in  the  absence  of  dissent  (i.e.  there  were  no  dissenting  views  in 
Survey,  Part-2  ROUND  ONE).  Table  9  contains  a  snapshot  of  the  demographics  of  the 
Survey,  Part-2  ROUND  ONE  respondents. 
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Table  9  -  Survey,  Part-2  ROUND  ONE  Panel  of  Experts  Demographic  Data 


a 

z 

=> 

o 

Rank 

Number 

Average  Number  Years 
Aircraft/Munitions  Maintenance 
Experience 

QC 

^  Hi 

r  z 

Lt  Colonel 

2 

22 

Major 

2 

12 

TO  O 
CL 

Captain 

2 

9 

> 

a> 

CMSgt 

19 

24 

> 

3 

SMSgt 

7 

18 

w 

Totals 

32 

20.9 

However,  due  to  the  extensive  amount  of  time  required  to  accomplish  Survey, 
Part-2  ROUND  ONE,  it  was  obvious  that  Survey,  Part-2  ROUND  TWO  needed  to  be 
structured  in  a  more  streamlined  fashion.  Using  the  coefficient  of  variation  (CV) 
discriminator  method  gave  us  the  ability  to  compare  the  variation  of  two  or  more 
different  variables  and  provides  a  standardized  view  of  variability  across  all  570 
responses  to  gain  a  better  understanding  of  the  variability  present  in  the  data.  The 
following  is  the  formula  for  computing  the  population  coefficient  of  variation: 

PopulationCV=  —  (note:  a  =  standard  deviation;  u  =  mean). 

F 

CV  thresholds  between  0  and  1.0  were  iteratively  applied  to  all  570  panel  mean 
data  responses  in  an  attempt  to  come  up  with  a  test  factor  that  would  illuminate  the  “Fail” 
responses  (indicating  a  lack  of  agreement  among  the  experts)  that  would  be  needed  to  be 
addressed  by  the  panel  in  ROUND  TWO  due  to  variability  present  in  the  responses. 
However,  even  at  the  lowest  CV  test  factor,  there  were  still  over  500  individual  responses 
which  were  a  “fail”.  After  carefully  analyzing  the  data,  a  CV  factor  of  0.29  was 
determined  as  an  appropriate  “trip-wire”  even  though  this  still  created  a  ROUND  TWO 
comprised  of  529  individual  responses  that  failed  the  ROUND  ONE.  We  then  used  these 
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“fails”  to  develop  a  spreadsheet-based  instrument  to  use  in  Survey,  Part-2  -  ROUND 
TWO. 

Survey,  Part-2  -  ROUND  TWO 

In  ROUND  TWO  of  Survey,  Part-2,  a  spreadsheet  was  sent  out  to  each  Delphi 
panelist  for  them  to  compare  their  ratings  with  the  aggregated  ratings  of  the  Delphi  panel 
as  a  whole.  This  spreadsheet  included  a  matrix  with  all  group  means  (this  matrix  placed 
at  the  bottom  of  the  spreadsheet),  a  matrix  with  the  respondent’s  responses  from  ROUND 
ONE  (this  matrix  placed  in  the  middle  of  the  spreadsheet),  and  a  changeable  matrix  with 
blacked  out  cells  that  were  not  statistically  different  from  ROUND  ONE  (this  matrix  was 
placed  at  the  top  of  the  spreadsheet).  Additionally,  to  make  it  easier  for  the  panelist  to 
navigate  within  the  matrix  without  having  to  continually  refer  to  the  attached  AFMAN 
36-2108  AFSC  Duty  Description  page  (see  Appendix  CL),  each  ratable  cell  within  the 
spreadsheet  included  an  imbedded  comment  describing  exactly  what  the  panelists  were 
being  asked  to  rate  (e.g.  Egress  Sys  Jymn/Crftmn  effectiveness  in  MX  Supt,  Non-Tac 
Acft  QA  Position).  Lastly,  a  “comments”  section  was  provided  on  the  bottom  of  the 
grading  sheet  to  give  each  panelist  the  opportunity  to  provide  feedback  (see  Appendix  E). 

Respondents  were  instructed  to  analyze  the  aggregated  manning  effectiveness 
matrix  derived  from  ROUND  ONE  and  any  comments  provided  by  other  panel  members. 
If,  after  viewing  the  data,  they  wished  to  modify  any  of  their  ROUND  ONE  ratings,  the 
panelist  was  instructed  to  fill  in  their  ratings  in  the  top  matrix  then  send  the  completed 
file  back  to  the  researcher.  This  was  considered  their  Survey,  Part-2  ROUND  TWO 
response  (See  Table  10).  Of  the  14  responses  received  from  respondents  in  ROUND 
TWO,  thirteen  modified  their  ROUND  ONE  responses  in  varying  degrees  while  one 
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panelist  held  fast  on  his  ROUND  ONE  responses.  Also,  only  one  panelist  provided 
comments  (see  Table  1 1).  Table  12  is  a  demographic  snapshot  of  the  14  respondents  in 
Survey,  Part-2  ROUND  TWO.  The  data  responses  from  ROUND  TWO  were  then  used 
as  a  basis  to  develop  the  Aircraft  Maintenance  QA  Manning  Effectiveness  Matrix.  (Note: 
It  was  determined  from  e-mail  and  telephonic  responses  from  the  majority  of  members  on 
the  Delphi  panel  to  the  researcher,  that  a  third  round  of  the  Delphi  technique  would  result 
in  no  further  adjustment  to  their  individual  ratings,  and  thus  would  be  counterproductive 
to  the  effort). 


Table  10  -  Survey,  Part-2  ROUND  TWO  Initial  Response  -  QA  Effectiveness 
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Table  1 1  -  Survey,  Part-2  ROUND  TWO  Panel  of  Experts’  Comments 


_ Survey,  Part-2  ROUND  TWO  Comments _ 

I  was  fully  satisfied  with  the  original  percentages. _ 

I  have  worked  with  “out  of  limits”  inspectors  before  at  Base  X  and  Prince  Sultan  Air 
Base,  Saudi  Arabia.  Their  ability  to  perform  was  adequately  captured  in  the  1-5  scale 
you  gave. _ 

I  believe  that  QA  is  a  meter  of  the  maintenance  being  done,  and  not  a 

driver. .  .therefore,  no  matter  how  well  (or  poorly)  QA  does  their  job,  maintenance 

indicators  will  not  be  dramatically  affected  (either  good  or  bad). _ 

It  is  imperative  that  the  best  match  possible  be  made  to  ensure  the  Commanders  get  the 
best  picture  of  the  job  being  done. .  .additionally  we  must  not  skimp  on  manning  the 
slots. _ 

I  know  in  this  day  and  age  of  force  shaping,  my  opinion  runs  against  the  current,  but  we 
have  reached  a  point  where  you  can’t  cut  anymore  without  affecting  the  quality  of 
maintenance.  The  use  of  technology  is  all  well  and  good,  and  the  inclusion  of  “less 
maintenance  intense”  aircraft  is  a  step  in  the  right  direction  (remember  the  F-15  self 
diagnostics  and  the  B-l  central  integrated  test  system)  nothing  will  replace  the  right 
number  of  well  qualified  Airmen. _ 


Table  12  -  Survey,  Part-2  ROUND  TWO  Panel  of  Experts  Demographic  Data 


Survey,  Part  -2  ROUND 
TWO 

Rank 

Number 

Average  Number  Years 
Aircraft/Munitions  Maintenance 
Experience 

Lt  Colonel 

1 

18 

Major 

1 

15 

Captain 

1 

9 

CMSqt 

8 

24 

SMSgt 

3 

18 

Totals 

14 

20.4 

As  is  the  case  in  many  studies  using  the  Delphi  method,  the  variability  in 
responses  can  create  problems  when  trying  to  gain  utility  from  the  data.  But,  the 
variability  in  itself  is  good  -  it  accurately  reflects  reality.  These  differences  of  opinion 
exist  in  leadership  and  management  levels  throughout  the  Air  Force  and  are  one  of  the 
motivators  behind  making  things  happen.  For,  if  everyone  thought  exactly  alike, 
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creativity  and  ingenuity  would  be  stifled.  This  variability  only  strengthens  results.  But 
how  do  we  best  handle  it  to  gain  the  utility  we  spoke  of  earlier? 

In  the  case  of  the  AFSC  manning  effectiveness  rates  determined  by  two  Delphi 
rounds,  there  was  variability,  and,  to  get  a  usable  worker  effectiveness  matrix,  we  needed 
to  determine  how  to  treat  the  data.  First,  since  we  did  not  want  to  mix  data  sets,  we  only 
used  data  from  panelists  who  responded  to  both  ROUNDS  ONE  and  TWO.  Next  we 
adopted  a  low,  medium,  high  approach  to  ensure  that  the  variability  of  the  data  was 
properly  addressed  in  the  QA  manning  effectiveness  matrix.  To  accomplish  this,  three 
separate  and  distinct  matrixes  were  derived  utilizing  the  statistical  quartile  approach  (i.e. 
one  matrix  based  on  quartile-one,  one  matrix  based  on  quartile-two,  and  one  matrix  based 
on  quartile-three)  to  be  used  in  Phase-Two.  These  matrixes  were  then  applied  toward  the 
resultant  manning  derived  from  Phase-Two.  This  was  the  conclusion  of  Phase-One  of  the 
research  study  and  the  input  to  Phase-Two. 

Phase  Two  of  the  Study 

Determining  How  ACC  Units  Have  Manned  Their  QA  Flights 

In  Phase  Two  we  need  to  answer  the  question:  “How  have  ACC  aircraft  wings 
historically  manned  their  aircraft  QA  manning  positions”  (i.e.  we  need  to  quantify  the 
manning  fit  in  relation  to  the  UMD)?  To  answer  this,  a  spreadsheet  was  developed  (see 
Appendix  F)  and  sent  to  each  of  the  16  selected  ACC  QA  flights  for  them  to  provide  a 
24-month  view  of  their  historical  manning  (see  Table  13). 
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Table  13  -  List  of  Participating  ACC  Bases/Units  in  Study 


ACC  Units  in  Study 

Barksdale  AFB  (2  BW) 

Minot  AFB  (5  BW) 

Beale  AFB  (9  RW) 

Mountain  Home  AFB  (366  FW) 

Cannon  AFB  (27FW) 

Nellis  AFB  (57  FW) 

Davis-Monthan  AFB  (355  FW) 

Offutt  AFB  (55  RW) 

Dyess  AFB  (7  BW) 

Pope  AFB  (28  FG) 

Ellsworth  AFB  (28  BW) 

Seymour-Johnson  AFB  (4  FW) 

Holloman  AFB  (49  FW) 

Shaw  AFB  (20  FW) 

Langley  AFB  (1  FW) 

Whiteman  AFB  (509  BW) 

Specifically,  each  ACC  QA  flight  was  asked  to  fill  in  the  provided  spreadsheet 
with  an  authorized  AFSC  and  an  assigned  AFSC  for  each  manpower  position  on  their 
UMD,  by  month,  from  January  2003  to  December  2004.  The  completed  and  returned 
ACC  unit  UMD  spreadsheets  along  with  the  Aircraft  Maintenance  QA  Manning 
Effectiveness  Matrix  derived  in  Phase-One  were  then  used  to  compute  an  overall  quality 
assurance  effectiveness  percentage  of  aggregated  assigned  manning  for  each  ACC  QA 
flight  by  month. 

Comparing  MXG  Manning  with  QA  Flight  Manning  Effectiveness 

In  order  to  address  a  large  issue  with  the  data,  monthly  assigned  and  authorized 
manning  levels  for  maintenance  AFSCs  assigned  to  each  of  the  ACC  units’  Maintenance 
Groups  (MXG)  under  study  were  requested  from  ACC/DPIM.  However,  due  to 
computer  database  limitations  at  ACC/DPIM,  acquiring  a  complete  historical 
representation  of  assigned  manning  at  the  units  under  study  for  the  entire  timeframe  was 
impossible.  Therefore,  only  monthly  manning  data  from  January  2004  to  December  2004 
was  available.  Furthermore,  since  gathering  the  data  by  AFSC  to  the  five  significant 
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digit-level  would  be  an  expensive  manpower  drain  on  ACC/DPIM  resources,  only 
aggregated  AFSC  data  for  the  2A,  2E,  2M and  2W  AFS’s  at  the  two-digit  level  was 
requested.  The  retrieved  data  was  then  paired  down  to  AFS’s  that  significantly  impacted 
the  study  ( 2A ’s  and  2W’s).  This  was  considered  sufficient  since  the  2E  and  2M  AFS’s 
comprised  less  than  0.08  percent  of  overall  assigned  QA  manpower  for  all  authorized 
AFS’s  and  were  found  at  only  two  of  the  participating  units  in  the  study. 

Once  the  manning  data  was  received,  it  was  parsed  to  eliminate  assigned  and 
authorized  three-levels  AFSCs  from  the  data  in  order  to  ensure  only  those  AFSCs  and 
skill  levels  normally  assigned  to  ACC  QA  flights  (i.e.  5-,  7-,  9-,  and  0-level  AFSCs)  were 
counted.  Next,  all  assigned  and  all  authorized  manning  for  both  of  the  two  focal  AFS’s 
(i.e.  2 A  plus  2W assigned;  2 A  plus  2W authorized)  were  summed  for  each  unit  under 
study.  We  then  calculated  a  ratio  of  overall  assigned-to-authorized  by  unit,  by  month,  to 
gain  an  understanding  into  each  unit’s  overall  manning  structure.  Although  this  overall 
MXG  manning  data  covered  only  half  of  the  timeframe  covered  by  the  study  for  our 
computed  QA  manning  effectiveness  data,  it  still  provided  limited,  but  valuable  insight 
into  the  manning  practice  of  the  units  under  study. 

Phase-Three  of  the  Study 

In  Phase  Three  we  compiled  data  from  each  of  the  units  in  the  key  unit-  and  wing- 
level  metrics  areas  indicated  by  the  Delphi  panel  of  experts  in  Survey,  Part-1  in  Phase- 
One  of  the  study  for  the  timeframe,  January  2003  to  December  2004.  Specifically,  we 
gathered  only  maintenance-related  historical  flying  safety  data  (Class  A,  B,  C  from  the 
Air  Force  Safety  Center)  and  maintenance-related  ground  safety  data  (Class  A,  B,  C,  and 
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Other  from  the  HQ/ACC  Ground  Safety  Office).  Furthennore,  we  acquired  QA  metrics 
from  each  of  the  unit’s  QA  flights  under  study  (i.e.  various  inspection  pass  rates),  and 
Foreign  Object  Damage  (FOD)  along  with  Dropped  Object  (DOP)  data  from  each  of  the 
unit’s  FOD/DOP  monitors.  Lastly,  we  accumulated  the  remainder  of  the  key  unit  metrics 
from  the  units’  Maintenance  Analysis  Flights  (i.e.  Flying  Scheduling  Effectiveness  Rate, 
Mission  Capable  Rate,  Repeat  Rate,  Recur  Rate,  etc.). 

We  next  applied  the  results  of  Phase-Two  (e.g.  calculated  QA  flight  manning 
effectiveness)  to  all  of  the  participating  maintenance  units  that  had  differing  overall  QA 
manning  effectiveness  levels  to  the  gathered  data.  We  first  performed  a  Pearson 
product-moment  correlation  coefficient  analysis  between  each  of  the  indicated  metrics 
(i.e.  Mission  Capable  Repeat,  FOD/DOP,  Mishaps,  etc.)  to  the  calculated  QA  manning 
effectiveness  rate  for  each  participating  unit  in  an  effort  to  determine  any  existing 
bivariate  relationships.  We  then  performed  a  regression  analysis  between  the  QA 
manning  effectiveness  rates  and  each  of  the  indicated  metrics  across  all  participating 
ACC  units. 

Phase-Four  of  the  Study 

Phase-Four  completed  the  study  by  answering  Investigative  Question-3:  “What  is 
the  relationship  between  QA  flight  manning  effectiveness  and  the  key  unit-  and  wing- 
level  metrics?”  This  was  accomplished  by  analyzing  and  evaluating  the  statistical  results 
to  derive  any  practical  usefulness  to  aircraft  maintenance  managers  making  QA  manning 
decisions.  Using  these  results,  we  then  perfonned  a  sample  benefit-cost  analysis.  And 
lastly,  the  statistical  results  were  analyzed  in  an  attempt  to  validate  what  the  experts  in  the 
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field  felt  the  impact  that  QA  as  an  entity  has  on  key  unit-  and  wing-level  metrics.  This 
was  performed  by  comparing  the  experts’  responses  in  Phase-One,  Survey,  Part-1  and  the 
statistical  measures  derived  from  Phase-Three  to  determine  where  they  matched,  and 
where  they  differed. 

Scope  and  Limitations  of  Research  Study 

Data  Collection  Issues 

There  were  several  instances  where  units  chose  not  collect  certain  types  of 
optional  metric  data  (e.g.  one  unit  does  not  collect  Phase  Key  Task  List  Pass  rate  data 
separately  from  Quality  Verification  Pass  rate  data).  To  handle  this,  we  used  statistical 
tools  such  as  pair-wise  analysis  versus  list-wise  analysis.  Also,  one  unit  could  not  give 
the  full  24-month  QA  assigned  manning  look-back  which  we  also  handled  with  pair-wise 
analysis. 

About  Correlation  and  Regression  Analysis 

When  considering  the  correlation  analysis,  it  frequently  may  not  be  appropriate  to 
consider  the  X-values  as  known  constants  whereas  correlation  analysis  provides  an 
avenue  to  infer  relationships  between  variables  without  risking  errors  associated  with 
confidence  coefficients  (Kutner,  Nachtsheim,  Neter,  and  Li,  2004).  In  our  procedures,  we 
attempted  to  derive  any  existing  significant  correlation  and  direction  between  the 
indicated  overall  QA  flight  manning  effectiveness  levels  and  each  of  the  indicated 
metrics.  The  results  of  this  analysis  were  used  to  draw  conclusions  and  postulate 
potential  mitigating  strategies  for  maintenance  leaders  and  managers  to  use  when 
assigning  personnel  to  QA  Flight  manpower  positions  in  the  final  phase  of  the  study. 
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Addressing  Potential  Problems  with  Self-Reports 

Padsakoff  and  Organ  identified  six  categories  of  self-report  (i.e.  a  survey  is  a  self- 
report),  presented  circumstances  where  problems  may  manifest,  and  discussed  methods 
for  mitigating  these  problems.  The  six  identified  categories  of  self-report  are: 

1)  Obtaining  demographic  or  otherwise  factual  data  (such  as  age  or  sex  of 
respondent,  years  of  tenure,  etc.),  that  are,  in  principle,  verifiable  form  other 
sources. 

2)  Assessing  the  effectiveness  of  experimental  manipulations. 

3)  Gathering  personality  data  (trait,  anxiety,  need  for  achievement,  locus  of  control, 
and  so  forth). 

4)  Obtaining  descriptions  of  a  respondent ’s  past  or  characteristic  behavior  (e.g., 
asking  supervisors  about  there  “structuring”  behaviors),  and/or  seeking 
respondent’s  intentions  of future  behavior  (e.g.,  to  quit),  or  how  they  would 
behave  under  certain  hypothetical  conditions  (i.e.,  various  role-playing 
exercises). 

5)  Scaling  the  psychological  states  of  respondents,  such  as  job  attitudes,  tension,  or 
motivation. 

6)  Soliciting  respondents  ’perceptions  of  an  external  environmental  variable  (the 
supervisor’s  behavior,  formalization  of  organizational  processes,  climate) 
(Podsakoff  and  Organ,  1985). 

For  our  surveys,  we  need  to  address  category  ‘  1  ’  since  we  gathered  demographic  data  on 
our  respondents  for  the  purpose  of  verifying  their  status  as  maintenance  subject  matter 
experts.  Category  ‘6’  was  also  relevant  since  respondents  were  asked  to  provide  opinions 
on  which  key  unit-  and  wing-level  metrics  are  most  impacted  by  QA  effectiveness  along 
with  how  they  felt  workers  would  perform  under  certain  circumstances. 

When  addressing,  category- 1  problems,  we  were  well  assured  that  the  responses 
were  correct  for  the  two  primary  data  elements:  years  of  aircraft/munitions  maintenance 
experience  and  rank.  Since  all  respondents  were  military  personnel,  their  reported  years 
of  experience  can  reasonably  be  expected  to  coincide  closely  with  the  job  position  they 
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held  (i.e.  a  QA  maintenance  superintendent  or  a  maintenance  group  chief  would  most 
likely  have  not  risen  to  that  position  without  substantial  experience). 

When  it  came  to  category-6  issues,  we  addressed  the  potential  biases  inherent  in 
perception-based  surveys.  To  help  control  for  this,  we  first  ensured  not  to  provide  too 
much  detail  to  the  respondents  as  to  the  nature  of  the  survey,  beyond  providing  basic 
instructional  guidance.  In  essence,  we  did  not  want  respondents  to  know  the  overall 
intent  of  the  study  so  as  to  avert  the  potential  that  they  would  overtly  or  unintentionally 
stage  their  answers  in  an  attempt  to  bias  the  survey. 

A  second  issue  with  our  survey,  was  the  shear  magnitude  of  time  required  to 
complete  Survey,  Part-2  since  it  was  expected  (from  a  beta-test)  to  take  anywhere  from 
30-minutes  to  two-hours  per  respondent,  for  each  round  of  the  Delphi.  According  to 
Padsakaoff,  et  ah,  respondents  taking  long  surveys  can  experience  “transient  mood 
states”  where  a  consistent,  yet  artifactual  bias  may  be  introduced  across  measures.  To 
control  for  this,  we  provided  a  “Save  &  Return  Later”  function  in  the  computer-based 
Survey,  part  II  ROUND-ONE.  Also,  since  we  conducted  Survey,  Part  II,  ROUND-TWO 
through  a  spreadsheet-based  instrument,  this  also  allowed  respondents  to  start,  save,  and 
restart  as  required. 

Another  issue  we  addressed  is  the  potential  bias  attributable  to  trait,  source  and 
methods.  For  instance,  in  our  study,  a  respondent  who  is  a  “crew  chief  by  trade”  may 
have  tended  to  have  consistently  higher  or  lower  expectations  on  how  effective  another 
person  possessing  their  same  AFSC  may  perform  other  jobs  (i.e.  an  electrician 
respondent  may  feel  that  an  average  electrician  would  be  more  apt  to  handle  any  job  they 
are  assigned  to  well,  and  thus  this  may  bias  their  ratings  when  considering  electricians. 
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This  is  because  they  are  experts  on  electrical  systems  and  the  electricians  who  work 
them).  However,  this  particular  bias  would  most  likely  not  exist  when  these  same 
personnel  are  considering  workers  possessing  other  AFSCs. 

To  counteract  this  potentiality,  we  provided  straightforward  and  explicit 
instructions  repeatedly  through  the  Delphi  rounds  for  the  respondents  to  ensure  they 
considered  “average”  personnel  and  also  to  base  their  responses  on  their  own  experiences 
and  beliefs  (see  Delphi  instructions  in  Appendixes  A-D). 

Lastly,  we  controlled  for  this  potential  bias  by  ensuring  our  respondent  group  was 
diverse  and  varied.  In  the  aggregate,  personnel  in  our  respondent  group  possessed  many 
different  ranks,  came  from  many  different  AFSC  backgrounds  (crew  chiefs,  avionics, 
munitions,  weapons,  structural  repair,  fuels  systems,  etc.),  worked  on  different  aircraft 
and  munitions  types  (bombers,  fighters,  special  assets),  and  were  assigned  to  many 
different  bases  (see  Tables,  5,  7,  10,  12).  This  good  cross-sectional  response  is 
considered  to  have  mitigated  any  remaining  biases.  We  coupled  these  strategies,  with  the 
power  of  the  Delphi  method  to  eliminate  the  “round-table”  meeting  influence,  and 
achieved  a  very  robust  system  of  bias-mitigating  check  and  balances. 

In  the  next  chapter,  we  calculate  an  overall  manning  effectiveness  level  by  month 
for  each  of  the  unit‘s  QA  flight  by  applying  the  derived  manning  effectiveness  matrix 
from  Phase-One  of  the  study  to  the  data  acquired  from  the  units  under  study  from  Phase- 
Two.  We  will  also  examine  the  overall  MXG  assigned  manning  as  it  related  to  the 
calculated  QA  manning  effectiveness  levels. 
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IV.  Results  -  QA  Manning  Effectiveness 

Overview 

In  this  chapter  we  calculate  the  overall  manning  effectiveness  for  each  of  the  QA 
flights  and  then  perform  an  analysis  of  Maintenance  Group  (MXG)  assigned  manning  as 
it  relates  to  this  effectiveness. 

Our  Assumptions 

The  following  assumptions  were  used  in  evaluating  results  in  Chapters  IV  and  V: 

1)  The  Unit  Manning  Document  requirements  are  the  optimum  manning  needs  to 
create  the  best  mix  of  maintenance  oversight  and  worker  capability. 

2)  The  models  we  create  are  interpretive,  not  predictive. 

3)  The  models  we  create  provide  a  broad  view  across  all  participating  units  and  may 
or  may  not  be  indicative  of  a  hard  and  fast  rule  applicable  to  all  units. 

4)  Although  we  understand  that  QA  personnel  are  pulled  from  the  larger 
Maintenance  Group  (MXG)  manning  pool,  we  will  not  attempt  to  model  the 
dichotomy  of  tradeoffs  caused  by  this  action  (i.e.  what  would  be  the  opportunity 
cost  of  pulling  a  technician  off  the  flight  line  and  put  them  in  a  QA  position?). 

5)  All  quantitative  monetary  analyses  assume  a  person  is  hired  into  the  MXG  and  a 
technician  from  the  MXG  manning  pools  possessing  the  required  six  months 
time-on-station,  is  then  assigned  to  QA. 

6)  Once  a  person  is  assigned  to  a  manpower  position  at  a  unit,  there  is  a  one-month 
lag  between  their  arrival  at  the  duty  station  and  them  becoming  a  viable  asset  to 


the  unit. 


7)  All  persons  possessing  the  AFS’s  in  the  reported  manning  data  are  fully  capable, 
are  assigned  as  assets  under  the  MX  Group  manning  structure,  and  are  not 
performing  duties  outside  of  their  AFS  (e.g.  Dormitory  Chief,  Honor  Guard,  etc.). 
Table  19  and  Figure  12  examine  this  correlation. 

Calculating  Manning  Effectiveness  Levels  for  QA  Flights 

After  examining  all  of  the  historically  assigned  manning  lists  from  each  of  the  QA 
flights,  we  discovered  several  instances  where  AFSCs  other  than  those  that  were 
authorized  by  the  aggregated  ACC  Unit  Manning  Document  (UMD)  from  Phase-One, 
were  being  used  in  QA  flights.  This  created  a  problem  where  we  needed  to  go  back  to 
the  Delphi  Panel  to  get  them  to  evaluate  the  effectiveness  of  each  of  these  ten  newly 
uncovered  AFSC  combinations. 

We  then  took  the  outcome  of  the  first  Delphi  study,  and  after  examining  the 
resultant  matrix,  determined  that  the  range  of  values  for  each  AFSC  combination  (i.e.  the 
1st  to  3rd  quartile  range)  was  relatively  small  for  the  majority  of  AFSC  combinations 
within  the  matrix.  Using  this  as  a  guide,  we  determined  the  median  value  for  each  AFSC 
combination  was  the  appropriate  effectiveness  rating  to  apply  to  any  AFSC-mismatch 
encountered  in  actual  QA  manning  data  received  from  the  field  (see  Table  14). 
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Table  14  -  Results  of  Initial  and  Supplemental  Delphi  Survey  -  AFSC  Combinations 
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30% 

20% 

50% 

25% 

30% 

20% 

25% 

27% 

20% 

20% 

5% 

5% 

10% 

10% 

10% 

10% 

2A7X4 

17% 

28% 

18% 

18% 

20% 

30% 

23% 

20% 

19% 

40% 

20% 

19% 

40% 

20% 

20% 

20% 

20% 

6% 

5% 

5% 

10% 

10% 

10% 

2E1X1 

20% 

20% 

20% 

20% 

14% 

20% 

15% 

12% 

20% 

19% 

8% 

9% 

9% 

9% 

9% 

20% 

9% 

7% 

lUliK 

51% 

13% 

5% 

5% 

5% 

2E2X1 

21% 

14% 

20% 

20% 

13% 

13% 

12% 

12% 

20% 

13% 

5% 

5% 

5% 

6% 

7% 

20% 

5% 

5% 

49% 

10% 

5% 

5% 

5% 

2M0X1 

14% 

16% 

11% 

11% 

7% 

14% 

8% 

8% 

9% 

15% 

7% 

8% 

7% 

7% 

7% 

9% 

7% 

4% 

7% 

7% 

11% 

10% 

15% 

2W0X1 

15% 

20% 

10% 

11% 

12% 

19% 

11% 

10% 

11% 

20% 

9% 

9% 

10% 

9% 

8% 

10% 

9% 

9% 

5% 

5% 

10% 

46% 

50% 

2W1X1 

18% 

30% 

18% 

19% 

20% 

23% 

20% 

18% 

15% 

27% 

11% 

10% 

10% 

10% 

13% 

15% 

10% 

5% 

4% 

4% 

8% 

59% 

ETiieI 

54% 

2W2X1 

17% 

20% 

12% 

13% 

14% 

20% 

14% 

14% 

13% 

20% 

10% 

9% 

10% 

7% 

10% 

13% 

10% 

7% 

5% 

5% 

18% 

48% 

50% 

Next,  we  formatted  each  of  the  16  returned  QA  flight  historical  manning  charts  and 
assigned  the  proper  effectiveness  rating  for  each  manpower  position  reported  by  month, 
for  each  unit.  When  assigning  effectiveness  ratings  to  each  authorized  position,  we  used 
the  following  four-rule  process: 

1)  If  an  authorized  QA  manpower  position  was  filled  with  a  person  possessing  the 
AFSC  called  for  in  the  UMD,  the  position  effectiveness  was  rated  100  percent 
effective  (e.g.  a  worker  with  AFSC  2A5X3  assigned  to  a  2A5X3  QA  position). 

2)  If  the  person  filling  a  QA  position  possessed  an  AFSC  other  than  that  called  for  in 
the  UMD,  the  appropriate  effectiveness  level  derived  from  the  QA  manning 
effectiveness  charts  was  assigned  to  that  position  (e.g.  a  person  with  AFSC 
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2A5X3  assigned  to  a  2A5X1  QA  position  would  be  rated  41  percent  effective  as 
derived  from  the  QA  Manning  Effectiveness  Matrix). 

3)  Instances  where  UMD  manpower  positions  were  double-filled  (i.e.  two  persons 
possessing  AFSC  2A3X3  were  assigned  against  one  UMD-authorized  2A3X3 
manpower  position),  were  rated  as  100  percent  effective.  The  rationale  for  this 
was  that,  although  not  authorized  for  in  the  UMD,  these  “extra”  personnel  provide 
capability  and  more  capability  “should  be  better”,  thus  proper  credit  should  be 
applied  to  possibly  offset  deficiencies  in  other  areas. 

4)  All  unfilled  QA  positions  were  rated  as  zero  percent  effective. 

Once  all  individual  QA  manpower  positions  were  assigned  manning  effectiveness 
ratings,  a  simple  average  was  computed  for  each  month  to  determine  each  QA  flight’s 
overall  manning  effectiveness  rating.  As  mentioned  earlier,  this  process  was  repeated  for 
all  individual  QA  positions,  by  month,  for  all  participating  QA  flights  (see  Table  15  for 
an  example  on  how  monthly  QA  effectiveness  is  calculated;  see  Appendixes  BK-1  to  BZ- 
2  for  all  participating  units’  calculated  QA  effectiveness  tables). 


Table  15  -  Excerpt  Example  of  Assigned  Unit  QA  Manpower  by  Position,  by  Month 


Jan  D4 

Score 

Fel)  D4 

Score 

Mar  D4 

Scoie 

MPN 

Auth'd 

Assn'd 

Auth'd 

Assn'd 

Auth'd 

Assn'd 

1 

XXXXXXXX 

2A300 

2A600 

90% 

2A300 

2A600 

90% 

2A300 

2A600 

90% 

3 

XXXXXXXX 

2A590 

2A571 

100% 

2A590 

2A571 

100% 

2A590 

2A571 

100% 

4 

XXXXXXXX 

2A571 

2A673 

25% 

2A571 

2A673 

25% 

2A571 

2A673 

25% 

5 

XXXXXXXX 

2A571 

100% 

2A571 

100% 

2A571 

100% 

6 

XXXXXXXX 

2A571 

100% 

2A571 

100% 

2A571 

100% 

7 

XXXXXXXX 

2A571 

100% 

2A571 

100% 

2A571 

100% 

8 

XXXXXXXX 

2A571 

2A571 

100% 

2A571 

2A571 

100% 

2A571 

2A571 

100% 

9 

XXXXXXXX 

2W271 

2W271 

100% 

2W271 

2W271 

100% 

2W271 

2W271 

100% 

10 

XXXXXXXX 

2A571 

2A571 

100% 

2A571 

2A571 

100% 

2A571 

2A571 

100% 

11 

XXXXXXXX 

2A571 

2A571 

100% 

2A571 

2A571 

100% 

2A571 

2A571 

100% 

12 

XXXXXXXX 

2A573A 

2A573A 

100% 

2A573A 

2A573A 

100% 

2A573A 

2A573A 

100% 

13 

XXXXXXXX 

2A573A 

NA 

0% 

2A573A 

NA 

0% 

2A573A 

NA 

0% 

14 

XXXXXXXX 

2A671A 

2A671A 

100% 

2A671A 

2A671A 

100% 

2AE71A 

2A671A 

100% 

15 

XXXXXXXX 

2W171 

2W171 

100% 

2W171 

2W171 

100% 

2W171 

2W171 

100% 

p 

5 


Monthly 
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Table  1 6  -  QA  Flig' 


it  Calculated 


Jan 

Fel) 

Mar 

Apr 

May 

Jim 

Jnl 

Ang 

Sep 

Oct 

Nov 

Dec 

Score 

Score 

Score 

Score 

Score 

Score 

Score 

Score 

Score 

Score 

Score 

Score 

Baiksrlale 

2003 

95% 

95% 

95% 

95% 

95% 

95% 

95% 

95% 

95% 

95% 

95% 

95% 

2004 

95% 

95% 

95% 

95% 

95% 

95% 

95% 

95% 

95% 

95% 

95% 

95% 

Beale 

2003 

66% 

66% 

61% 

63% 

63% 

63% 

59% 

59% 

59% 

56% 

56% 

56% 

2004 

56% 

56% 

53% 

56% 

56% 

56% 

56% 

53% 

56% 

56% 

56% 

69% 

Cannon 

2003 

90% 

90% 

90% 

90% 

90% 

90% 

90% 

90% 

88% 

88% 

88% 

88% 

2004 

85% 

85% 

85% 

85% 

85% 

85% 

85% 

85% 

86% 

86% 

86% 

86% 

DM 

'2003 

80% 

80% 

80% 

84% 

84% 

88% 

83% 

88% 

92% 

80% 

76% 

83% 

”2004 

79% 

82% 

84% 

84% 

84% 

85% 

85% 

85% 

88% 

81% 

85% 

84% 

Dyess 

"2003 

100% 

100% 

100% 

100% 

100% 

100% 

100% 

100% 

100% 

100% 

100% 

100% 

2004 

100% 

100% 

100% 

100% 

100% 

96% 

96% 

96% 

95% 

99% 

99% 

99% 

Ellswoith 

2003 

80% 

80% 

80% 

80% 

80% 

80% 

79% 

79% 

79% 

79% 

79% 

79% 

2004 

79% 

79% 

79% 

78% 

81% 

81% 

81% 

80% 

80% 

80% 

82% 

81% 

Holloman 

"2003 

100% 

100% 

100% 

100% 

100% 

100% 

100% 

100% 

100% 

100% 

100% 

100% 

"2004 

100% 

100% 

100% 

100% 

100% 

100% 

100% 

100% 

100% 

100% 

100% 

100% 

Langley 

2003 

85% 

85% 

85% 

85% 

85% 

85% 

85% 

85% 

85% 

85% 

85% 

85% 

2004 

85% 

85% 

85% 

85% 

85% 

85% 

84% 

84% 

84% 

87% 

87% 

87% 

Minot 

2003 

88% 

88% 

88% 

88% 

88% 

88% 

88% 

88% 

88% 

88% 

88% 

88% 

2004 

94% 

94% 

94% 

94% 

94% 

94% 

94% 

94% 

89% 

91% 

91% 

91% 

M-H 

2003 

86% 

86% 

83% 

83% 

83% 

82% 

82% 

82% 

82% 

82% 

84% 

84% 

2004 

84% 

84% 

84% 

84% 

84% 

84% 

84% 

84% 

84% 

82% 

82% 

82% 

Nellis 

2003 

87% 

87% 

87% 

87% 

87% 

87% 

87% 

87% 

87% 

87% 

87% 

87% 

2004 

87% 

87% 

87% 

87% 

87% 

87% 

93% 

93% 

93% 

93% 

93% 

93% 

Offntt 

2003 

65% 

65% 

65% 

65% 

65% 

65% 

65% 

65% 

65% 

69% 

69% 

69% 

2004 

73% 

73% 

73% 

76% 

76% 

76% 

76% 

81% 

81% 

81% 

81% 

81% 

Pope 

2003 

■2004 

76% 

76% 

76% 

76% 

81% 

87% 

87% 

78% 

84% 

90% 

90% 

84% 

SJ 

■2003 

92% 

92% 

92% 

92% 

92% 

92% 

92% 

92% 

92% 

92% 

92% 

92% 

2004 

92% 

92% 

92% 

92% 

92% 

92% 

92% 

92% 

92% 

92% 

92% 

92% 

Show 

2003 

97% 

97% 

97% 

97% 

97% 

97% 

97% 

97% 

97% 

97% 

97% 

97% 

2004 

97% 

97% 

97% 

97% 

97% 

97% 

100% 

100% 

100% 

100% 

100% 

100% 

Whiteman 

2003 

85% 

85% 

85% 

85% 

85% 

85% 

85% 

85% 

88% 

88% 

88% 

88% 

2004 

92% 

92% 

92% 

92% 

92% 

92% 

100% 

92% 

92% 

92% 

92% 

92% 

In  the  next  step  we  aggregate  the  monthly  manning  effectiveness  sores  for  all 
participating  QA  flights  into  one  chart  to  develop  our  time-series  (see  Table  16). 

Analyzing  the  Manning  Effectiveness  Levels  for  QA  Flights 

The  calculated  manning  effectiveness  levels  in  Table  16  reveal  that  all  but  two 
units  experienced  transitory  fluctuations  in  manning  effectiveness  from  month-to-month 
(one  had  a  stable  100  percent  calculated  QA  manning  effectiveness  and  the  other  had  a 
stable  95  percent  effectiveness  score  for  the  entire  timeframe  of  the  study).  Although  the 
stable  effectiveness  levels  is  desirable  in  daily  practice,  it  does  however  create  a 
confound  for  this  study  because  we  are  searching  for  links  associated  with  QA  manning 
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effectiveness  variability.  If  the  independent  variable  (i.e.  a  unit’s  calculated  QA  manning 
effectiveness  levels)  never  changes,  then  any  variability  in  the  dependant  metric  variable 
data  (e.g.  Mission  Capable  rate,  Repeat  rate,  Mishap  counts)  merely  becomes  noise. 


Comparing  Manning  for  MX  Groups  to  Calculated  QA  Effectiveness 

Since  all  QA  manning  is  taken  from  the  larger  Maintenance  Group  (MXG) 
manpower  structure,  its  manpower  is  dependant  upon  available  MXG  manning.  Thus,  it 
is  necessary  to  analyze  the  overall  MXG  manning  in  order  to  gain  an  understanding  into 
the  QA  manning  construct  and  the  cross-impacts  involved.  Furthermore,  the  capability  of 
acquiring  the  assigned  historical  MXG  manning  at  the  participating  units  was  hampered 
by  limited  access  to  the  data  and  manpower  resources  at  the  headquarters  level. 

However,  we  were  able  to  accumulate  and  calculate  an  assigned/authorized  manpower 
ratio  for  the  two  most  prevalent  AFS’s  (2 A  and  2W)  found  in  the  QA  flights  in  the  study 
for  the  timeframe  January  2004  to  December  2004  (see  Table  17). 


Table  17  -  MXG  Derived  2A  and  2W  Manning  for  Participating  Bases 


Jan  04 

Feb  04 

Mar  04 

Apr  04 

May  04 

Jun  04 

Jul  04 

Aug  04 

Sep  04 

Oct  04 

Nov  04 

Dec  04 

Barksdale 

87.1% 

86.7% 

87.1% 

86.9% 

92.8% 

92.3% 

91.5% 

94.9% 

93.0% 

91.9% 

88.7% 

89.6% 

Beale 

73.9% 

79.9% 

82.9% 

84.1% 

81.4% 

80.5% 

82.8% 

89.1% 

87.8% 

84.9% 

85.7% 

86.2% 

Cannon 

78.4% 

77.9% 

77.7% 

77.1% 

76.4% 

75.8% 

82.0% 

84.8% 

84.1% 

79.2% 

77.0% 

75.3% 

D-M 

78.9% 

78.5% 

81.2% 

90.9% 

91.1% 

91.4% 

91.6% 

97.1% 

96.7% 

93.7% 

92.8% 

90.7% 

Dyess 

75.1% 

75.7% 

76.9% 

77.7% 

77.4% 

77.3% 

78.7% 

93.2% 

93.3% 

90.5% 

89.5% 

88.7% 

Ellsworth 

78.3% 

78.4% 

78.1% 

83.2% 

81.8% 

79.9% 

79.6% 

92.8% 

92.4% 

92.3% 

91.3% 

90.2% 

Holloman 

73.2% 

73.4% 

75.6% 

82.3% 

85.0% 

83.3% 

82.9% 

87.8% 

87.6% 

87.8% 

86.5% 

86.5% 

Langley 

83.8% 

84.0% 

84.0% 

84.3% 

85.3% 

85.4% 

85.4% 

90.7% 

91.1% 

90.9% 

89.5% 

89.0% 

Minot 

79.0% 

81.5% 

84.7% 

87.6% 

86.8% 

88.6% 

87.1% 

89.4% 

87.9% 

87.5% 

86.4% 

88.7% 

M-H 

74.0% 

76.0% 

75.7% 

75.3% 

76.3% 

75.6% 

76.1% 

85.9% 

85.2% 

84.4% 

82.9% 

82.1% 

Nellis 

82.7% 

82.5% 

82.5% 

83.1% 

87.3% 

87.7% 

CO 

yo 

Ln 

a® 

92.7% 

93.0% 

92.6% 

92.7% 

93.4% 

Offutt 

84.1% 

82.1% 

81.8% 

57.6% 

90.5% 

90.2% 

88.6% 

96.6% 

95.6% 

91.1% 

89.7% 

89.4% 

Pope 

75.4% 

74.9% 

75.4% 

88.2*/. 

86.2% 

85.4% 

83.3% 

91.7% 

89.1% 

85.5% 

85.0% 

84.5% 

SJ 

79.4% 

77.6% 

79.9% 

80.2% 

79.6% 

80.1% 

80.6% 

89.7% 

89.0% 

88.8% 

88.1% 

88.3% 

Shaw 

86.0% 

87.2% 

88.7% 

87.0% 

86.9% 

86.6% 

84.9% 

95.2% 

93.5% 

93.4% 

92.3% 

92.5% 

Whiteman 

83.4% 

82.4% 

81.8% 

95.2% 

95.2% 

93.6% 

92.7% 

100.6% 

100.0% 

99.4% 

98.5% 

102.1% 
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Once  we  had  this  data,  we  perfonned  a  Pearson  product-moment  correlation 
coefficient  analysis  to  determine  the  linear  relationships  between  MXG  manning  and 
calculated  QA  manning  effectiveness. 


Table  18  -  MX  Group  Assigned  Manning  Correlated  w/  QA  Manning  Effectiveness 


Base 

Unit 

12-months  w/  1-month  Lag 

Langley 

1  FW 

-0.3544 

Barksdale 

2  BW 

0.0000 

Shaw 

20  FW 

0.9490 

Cannon 

27  FW 

-0.3798 

Ellsworth 

28  BW 

0.2077 

Pope 

28  FG 

0.4960 

Davis-\Ionthan 

355  FW 

0.6996 

\lountain  Home 

366  FW 

-0.3240 

S  evmour-  Johnson 

4  FW 

0.6735 

Holloman 

49  FW 

0.0000 

NIinot 

5  BW 

-0.1595 

Whiteman 

509  BW 

0.0000 

Oflutt 

55  RW 

0.5243 

Nellis 

57  FW 

0.8707 

Dyess 

7  BW 

-0.6764 

Beale 

9  RW 

-0.4132 

MXG  Manning  Correlated  w/  QA  Manning  Effectiveness 


1.0000 
0.8000 
0.6000 
0.4000 
|  0.2000 
■f  0.0000 
S  -0.2000 
°  -0.4000 
-0.6000 
-0.8000 
-1.0000 


■  1 -Month  Lag 


Figure  13  -  MXG  Assigned  Manning  Correlated  w/  QA  Manning  Effectiveness 
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We  used  a  1 -month  lag  in  the  analysis  (MXG  assigned  manning  in  month-y  is 
correlated  with  the  calculated  QA  flight  manning  effectiveness  in  Month  j+1)  to  account 
for  individual  unit  in-processing  actions,  etc.)-  From  this  we  found  that  three  units  (2 
BW,  509  BW,  and  49  FW)  have  a  zero-correlation  coefficient  between  their  MXG 
assigned  manning  and  their  QA  flight  manning  effectiveness.  This  was  the  expected 
result  in  the  case  of  the  2  BW  and  the  49  FW  since  there  was  no  variability  in  their 
calculated  QA  flight  manning  effectiveness,  while  there  was  in  the  corresponding  MXG 
assigned  manning  data.  Next  we  found  that  one  unit  has  a  weak  positive  correlation 
between  MXG  assigned  manning  and  QA  flight  manning  effectiveness  (28  BW),  five 
units  with  a  weak-to-moderate  negative  correlation  coefficient  (1  FW,  27  FW,  366  FW,  5 
BW,  and  9  RW),  and  one  unit  with  a  moderate  negative  correlation  coefficient  (7  BW). 
Lastly,  we  observed  five  units  with  a  moderate-to-strong  positive  correlation  between 
MXG  assigned  manning  and  QA  flight  manning  effectiveness  (355  FW,  4  FW,  55  RW, 
57  FW),  with  the  20  FW  having  a  near-perfect  correlation  (see  Table  18  and  Figure  13). 


Table  19  -  Pearson  Product-Moment  Correlation  Coefficient  Relationships 


Correlation 

Coefficient 

Indication 

Resultant  Action 

-1.0 

Strong  Positive 
Relationship 

As  one  variable  increases, 
the  other  variable  increases 

0.0 

No  Relationship 

None 

1.0 

Strong  Negative 
Relationship 

As  one  variable  increases, 
the  other  variable 
decreases 

We  performed  one  further  analysis  of  the  MXG  assigned  manning  as  it  related  to 
the  QA  manning  effectiveness  levels  which  consisted  on  counting  the  number  of  months 
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for  all  units  where  MXG  assigned  manning  exceeded  QA  flight  manning  effectiveness 
and  vice-versa.  We  then  took  this  raw  data  and  converted  it  to  a  ratio  for  all  ACC  bases. 


Table  20  -  Relationship  between  MXG  Manning  and  QA  Manning  Effectiveness 


1  -  i niii i,  r  no  t  i 1 1 •  • ' i 

1  V  1  If  1 1  \  •Ml" 

=  Months  MXG  Assigned 
>  QA  Effectiveness 

Barksdale 

11 

1 

Beale 

0 

12 

Caiuion 

12 

0 

I)  avis-lVIonthan 

2 

10 

Dyess 

12 

0 

Ellsworth 

5 

7 

o> 

Holloman 

12 

0 

C Y1 

Langley 

4 

s 

CS 

hlinot 

12 

0 

Mountain  Home 

7 

5 

HH 

Nellis 

9 

3 

Offntt 

0 

12 

Pope 

2 

10 

S  eymour- Johns  on 

12 

0 

Shaw 

12 

0 

Whiteman 

3 

9 

Total  Count 

192 

115 

77 

Percentages 

100.00% 

59.90% 

40.10% 

The  data  in  Table  20  indicate  that  for  approximately  60  percent  of  the  months  in  Calendar 
Year  2004  (using  zero-lag),  the  individual  units’  MXG  assigned  manning  for  AFS ’s  2 A 
and  2W was  less  than  the  calculated  QA  flight  effectiveness,  and  for  approximately  40 
percent  of  the  months,  MXG  assigned  manning  was  more  than  that  of  their  respective  QA 
flight’s  effectiveness  level.  This  raises  an  important  question  associated  with  this  study: 
“Should  QA  manning  track  that  of  assigned  manning  within  its  respective  MXG?”  In 
other  words,  should  all  maintenance  functions  share  equally  in  the  pain  when  there  is  a 
lack  of  manning  or  should  low-density,  high-demand  functions  be  fully  manned?  Since 
there  are  different  opinions  on  this,  we  will  table  it  for  now,  and  revisit  it  in  Chapter  VI. 
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Basically,  the  utility  of  this  data  to  the  study  is  that  it  paints  a  rough  picture  of 
how  manning  is  being  apportioned  by  the  various  units  to  their  QA  flights.  For  instance, 
for  a  unit  with  a  positive  correlation,  their  MXG  assigned  manning  fluctuates  in  the  same 
direction  as  their  QA  flight  manning  effectiveness.  On  the  other  hand,  the  negative 
correlation  for  manning  is  interesting,  because  this  indicates  that,  as  the  unit’s  assigned 
“2A  and  2W”  percentage  of  assigned  manning  changed,  the  QA  manning  effectiveness 
responded  with  a  change  in  the  opposite  direction. 

In  examining  the  manning  data  (see  Table  20),  this  anomaly  seems  to  be  caused 
more  by  variability  within  the  MXG  assigned  data  than  by  changes  within  the  QA  flight 
manning  effectiveness.  This  may  indicate  that  the  lag-factor  between  when  people  are 
assigned  to  a  maintenance  group  to  when  manning  structure  changes  are  actually  made, 
may  be  more  pronounced  than  just  the  one-month  lag  that  we  modeled. 


Table  21  -  Example  Raw  Data  used  for  Correlation  Calculations 


Shaw  AFB 

Whiteman  AFB 

Month 

MXG  Manning 

QA  Effectiveness 

MXG  Manning 

QA  Effectiveness 

Jan  04 

0.860 

0.967 

0.834 

0.913 

Feb  04 

0.872 

0.967 

0.824 

0.913 

Mar  04 

0.887 

0.967 

0.818 

0.913 

Apr  04 

0.870 

0.967 

0.952 

0.913 

May  04 

0.869 

0.967 

0.952 

0.913 

Jun  04 

0.866 

0.967 

0.936 

0.913 

Jul  04 

0.849 

1.000 

0.927 

0.913 

Aug  04 

0.952 

1.000 

1.006 

0.913 

Sep  04 

0.935 

1.000 

1.000 

0.913 

Oct  04 

0.934 

1.000 

0.994 

0.913 

Nov  04 

0.923 

1.000 

0.985 

0.913 

Dec  04 

0.925 

1.000 

1.021 

0.913 

We  need  to  caution  the  reader  not  to  draw  conclusions  based  solely  on  this 


correlation  data  for  various  reasons.  First,  this  correlation  analysis  is  based  on  a  limited 
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sample  size  of  data  points  for  only  twelve  months  of  MXG  manning.  Second,  the  data 
for  QA  flight  manning  effectiveness  is  not  a  raw  number  like  the  MXG  assigned  manning 
data  but  is  rather  a  calculated  percentage  based  on  the  derived  manning  effectiveness 
assignment  process.  Third,  manpower  at  stateside  assigned  bases  follow  a  “fair-share” 
process  whereby  average  worldwide  manning  levels  are  used  to  determine  percentages  of 
manning  for  each  AFSC  to  be  assigned  to  each  of  the  bases,  thus  there  is  no  one  model 
that  fits  all  of  the  units  under  study.  The  last  and  most  important  fact  to  consider  before 
passing  judgment,  is  the  very  dynamic  nature  of  the  manning  assignment  process  where 
maintenance  managers  make  daily  manpower  determinations  based  on  changing 
requirements  and  constraints. 

In  the  Chapter  V  we  examine  the  metric  data  relevant  to  the  calculated  QA 
manning  effectiveness  data  in  order  to  derive  any  relevant  insights,  and  in  Chapter  VI  we 
present  conclusions  and  recommendations. 
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V.  Results  -  Analyzing  the  Metrics  Relevant  to  QA  Manning  Effectiveness 
Overview 

In  this  chapter  we  use  the  Pearson  product-moment  correlation  coefficient 
analysis  procedure  to  investigate  relationships  between  the  calculated  QA  Manning 
Effectiveness  and  subsequent  time  lags  for  each  of  the  participating  units,  versus  the 
metrics  confirmed  by  the  subject  matter  experts  in  the  Delphi  Survey,  Part-1.  We  will 
also  perform  regression  analysis  to  determine  any  significance  between  the  independent 
variable  (QA  Manning  Effectiveness)  and  each  of  the  dependent  variables  arrayed  across 
the  16  ACC  units  in  the  study. 


The  Pearson  Product-Moment  Correlation  Coefficient 

Mathematically  the  Pearson  product-moment  correlation  coefficient  is: 


r  = 


SS„ 


sIK,SS 


yy 


(note:  SS  =sums  of  squares;  x=indep.  variable;  y=dep.  variable). 


This  is  a  useful  mathematical  tool  for  gaining  a  macro  view  of  linear  relationships 
between  individual  data  sets.  Furthermore,  to  save  time,  we  will  use  the  statistical 
analysis  software  program  JMPE’to  perform  the  correlation  calculations. 


The  Process  Overview  for  Analyzing  Each  Metric,  by  Variable,  by  Unit 

We  will  use  the  “by-metric”  approach  to  analyze  each  of  the  indicated  metrics. 
More  specifically,  we  will  analyze  each  of  the  25  metrics  in  alphabetical  order  and,  under 
each  of  the  specific  metric  headings,  we  will  first  define  each  metric  that  was  indicated 
by  the  Delphi  Panel  of  Experts  in  Phase-One  of  the  study.  We  will  then  use  the 


68 


<Multivariate>  command  in  JMP  8  for  each  of  the  metrics  (Abort,  Mission  Capable, 
Repeat,  Recur,  Mishap,  etc.)  and  the  QA  Manning  Effectiveness  rates  for  each  of  the 
units  to  create  a  correlation  matrix. 

This  correlation  matrix  will  provide  us  with  correlation  strength  (linear 
relationship)  along  with  the  direction  of  relationship  between  the  variables.  Furthennore, 
to  gain  greatest  insight  into  potential  lag-relationships  between  the  variables,  each  metric 
will  be  lagged  in  monthly  increments  from  zero  (contemporaneous)  to  four  (note:  a  QA 
manning  effect  on  a  resultant  metric  after  four  months  will  be  considered  to  have 
occurred  by  chance).  Next,  these  correlations  will  be  aggregated  and  collated  by  metric 
across  all  16  participating  units  to  allow  us  to  analyze  any  recurrent  themes.  First,  it 
should  be  noted  that  Barksdale  AFB  and  Holloman  AFB  are  not  included  on  any  of  the 
metric  correlation  analysis  tables  because  the  results  of  the  Pearson  product-moment 
correlation  analysis  will  always  indicate  a  zero  correlation  across  all  “Fags”.  This  is  due 
to  the  fact  that  both  units  had  zero  variation  in  their  calculated  QA  Manning 
Effectiveness  during  the  2003-2004  period  and  thus  zero  variability  within  any  of  the 
measured  metrics,  will  always  result  in  a  reported  zero  correlation  coefficient.  We  will 
begin  with  the  Abort  Rate  metric. 

Abort  Rate  (AR) 

The  AR  metric  is  a  leading  indicator  of  both  aircraft  reliability  and  quality  of 
maintenance  performed.  It  is  the  percentage  of  missions  aborted  in  the  air  and  on  the 
ground.  Furthermore,  an  abort  is  a  sortie  that  ends  prematurely  and  must  be  re¬ 
accomplished  (AFI  21-101,  para  1.10.3.1).  The  Abort  rate  is  calculated  as: 
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.  „  „ . ,  Air+GroundAborts 

AR(%)= - 

T  otalSortiesFlown+GroundAborts 


*100 


Analyzing  the  reported  Abort  rates  from  ACC/LGP  against  the  calculated  QA  manning 
effectiveness  rates  indicated  that  correlations  across  all  bases  were  not  uniform  for  Abort 


rates,  however  several  units  had  periods  of  relatively  high  correlations  (>  +/-  0.45)  (see 
Appendix  AF).  Also,  the  data  seems  to  indicate  a  negative  correlation  for  the  F-16, 

Block  30’s  at  Cannon  AFB  starting  in  Lag-0  and  lasting  until  Lag-3.  This  makes  sense  if 
the  QA  Manning  Effectiveness  was  a  factor  for  Aborts  (i.e.  as  Manning  Effectiveness 
increases,  Abort  rates  decrease  =  GOOD).  This  negative  relationship  also  occurred  at 
Mountain  Home  F-16,  Block  50’s  in  Lag-2  and  -3,  and  at  Pope  in  Lag-3. 

Conversely,  the  A- 10s  at  Davis-Monthan  AFB  indicate  a  moderate  positive 
correlation  for  operational  and  training  A- 10  units  across  Lags-0,  -1,  and  -2. 

Additionally,  five  aircraft  types  at  Nellis  AFB  exhibited  positive  correlations  over  several 
different  lags.  This  is  counter-intuitive,  since  we  would  expect  Abort  rates  to  decrease  if 
QA  manning  effectiveness  had  a  significant  impact  on  this  metric. 

The  overall  analysis  for  the  Abort  rate  metric  is  that  although  several  of  the 
individual  bases  indicate  potential  value  in  analyzing  Abort  rates  as  related  to  their 
individual  QA  manning  effectiveness  levels,  the  data  do  not  support  a  determination  that 
Abort  rates  can  be  directly  tied  to  QA  manning  effectiveness  as  a  potential  trend  across 
ACC  bases  (see  Survey,  Part-1  Comments,  Appendix  F).  We  will  now  examine  the 
Break  Rate  metric. 
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Break  Rate  (BR) 


The  BR  metric  is  a  leading,  flying-related  metric  and  is  an  indicator  of  both 
aircraft  reliability  and  quality  of  maintenance  performed.  It  is  the  percentage  of  aircraft 
that  land  “ Code-3 ”  (unable  to  complete  at  least  one  of  its  assigned  missions)  (AFI  21- 
101,  para  1.10.3.2).  It  is  calculated  as: 


BR(%)= 


NumberSortiesThatLandCode3 
T  otalSortiesFlown 


*100 


Analyzing  the  reported  Break  rates  from  ACC/LGP  against  the  calculated  QA  Manning 
Effectiveness  rates  yielded  the  results  listed  in  Appendix  AH.  As  the  appendix  reveals, 
correlations  across  all  bases  were  not  uniform  for  Break  rates,  with  nine  bases  with  at 
least  one  assigned  aircraft  unit  showing  a  weak  to  moderate  negative  correlation  (GOOD) 
between  Break  rate  and  QA  manning  effectiveness.  This  makes  sense  if  the  QA  manning 
effectiveness  was  a  factor  for  Break  rates  (i.e.  as  Manning  effectiveness  increases,  Break 
rates  decrease  =  GOOD). 

Conversely,  as  was  the  case  with  Abort  rates,  five  bases  had  Break  rates  in 
individual  aircraft  units  with  moderate  positive  correlations  between  Break  rate  and  QA 
manning  effectiveness.  Again,  this  is  counter-intuitive  since,  we  would  expect  to  see 
Break  rates  to  decrease  if  QA  manning  effectiveness  had  a  significant  impact  on  this 
metric  type. 

The  overall  determination  is  that  although  several  of  the  individual  bases  indicate 
potential  value  in  analyzing  Break  rates  as  related  to  their  individual  QA  manning 
effectiveness,  the  data  do  not  support  an  overall  detennination  that  Break  rates  can  be 
directly  tied  to  QA  manning  effectiveness  as  a  potential  trend  across  ACC  bases  (see 


71 


Survey,  Part-1  Comments,  Appendix  F).  The  next  metric  we  will  examine  is  the  CANN 
Rate  metric. 

Cannibalization  (CR)  Rate 

The  CR  metric  is  a  leading  indicator  that  reflects  the  number  of  cannibalization 
(CANN)  actions  (removal  of  a  serviceable  part  from  an  aircraft  or  engine  to  replace  an 
unserviceable  part  on  another  aircraft  or  engine).  Since  Base  Supply  relies  on  the 
maintenance  shops  and  depot  for  replenishment,  this  indicator  can  be  used  in  part  to 
indicate  maintenance  shop  and  depot  support  (AFI  21-101,  para  1.10.3.2).  It  is  calculated 
as: 

CR(%)=  NUmbCrAirCrallEng'nCCANN S  *  1  QQ 
T  otalSortiesFlown 

Analyzing  the  reported  CANN  rates  from  ACC/LGP  against  the  calculated  QA  manning 
effectiveness  rates  yielded  the  results  listed  in  Appendix  AI.  As  the  appendix  shows, 
correlations  across  all  bases  were  not  uniform  for  CANN  rates,  but  at  eleven  of  the  14 
bases,  CANN  rates  indicated  a  moderately  negative  (GOOD)  correlation  between  CANN 
rates  and  QA  manning  effectiveness  for  at  least  one  aircraft  unit  at  each  base  but  mainly 
concentrated  in  the  Lag-1  to  -3  range.  This  makes  sense  if  QA  manning  effectiveness  is  a 
factor  for  CANN  Rates  (i.e.  as  QA  manning  effectiveness  increases  CANN  rates 
decrease=GOOD) . 

Conversely,  as  was  the  case  with  Aborts,  eight  bases  had  CANN  rates  in 
individual  aircraft  units  with  moderate  positive  correlations  between  CANN  rates  and  QA 
manning  effectiveness.  Again,  this  is  counter-intuitive,  since  we  would  expect  to  see 
CANN  rates  decrease  if  QA  manning  effectiveness  had  a  significant  impact  on  this 
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metric.  The  overall  determination  is  that  there  is  some  evidence  at  the  majority  of 
maintenance  units  in  the  study  to  indicate  potential  value  in  analyzing  CANN  rates  as 
related  to  their  individual  QA  manning  effectiveness  across  ACC  bases  (see  Survey,  Part- 
1  Comments,  Appendix  F).  We  will  now  examine  the  Combined  Mishap  Count  metric. 

Combined  Mishap  (CombMis)  Count 

The  CombMis  Count  metric  is  an  aggregated  count  of  all  Class  A,  B,  and  C 
Mishaps  both  for  flight  and  ground  that  are  specifically  related  to  maintenance.  Also 
included  are  preventable  aviation  maintenance-related  injuries  and  incidents  that  did  not 
meet  the  $20,000  minimum  reporting  criteria.  Basically,  the  Combined  Mishap  Count  is 
a  measure  of  the  extent  that  maintainers  follow  directives.  Analyzing  the  reported 
Combined  Mishap  counts  acquired  from  the  Air  Force  Safety  Center  and  ACC  Ground 
Safety  against  QA  manning  effectiveness  rates  yielded  the  results  listed  in  Appendix  AO. 
As  the  appendix  shows,  correlations  across  all  bases  were  not  uniform  for  Combined 
Mishaps  counts,  but  seven  of  the  14  bases  indicated  moderate  negative  correlations  with 
QA  manning  effectiveness  Rates  (GOOD)  for  Lag-0  to  Lag-3.  Furthennore,  three  of  the 
remaining  seven  bases  indicated  a  moderate  positive  correlation  between  Combined 
Mishaps  and  QA  manning  effectiveness  (BAD)  in  Lag-0.  Although  the  data  do  not 
support  categorizing  the  negative  correlations  as  a  trend  across  all  ACC  units  under 
study,  any  correlations  (positive  or  negative)  of  Combined  Mishap  counts  with  any  other 
variable  should  be  promptly  examined  by  maintenance  management  and  the  necessary 
mitigating  strategies  implemented  (see  Survey,  Part-1  Comments,  Appendix  F).  The  next 
two  metrics,  Dropped  Object  and  Foreign  Object  Damage  counts,  are  examined  together 
because  they  are  both  important  indicators  of  the  quality  of  a  base’s  maintenance 
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practices  and  are  monitored  and  reported  by  each  base’s  Foreign  Object  Damage 
Prevention  office. 

Dropped  Object  (DOP)  and  Foreign  Object  Damage  (FOD)  Counts 

The  DOP  and  FOD  Count  metrics  are  two  separate  metrics  and  are  aggregated 
counts  of  occurrences  of  preventable  Dropped  Object  counts  and  Foreign  Object  Damage 
counts  respectively.  A  Dropped  Object  is  an  item  that  falls  off  of  an  aircraft  (un¬ 
commanded)  while  in-flight.  More  specifically,  our  data  only  includes  those  DOPs 
attributable  to  maintenance.  A  FOD  incident  is  a  maintenance-related  occurrence  of 
“preventable”  damage  caused  by  a  foreign  object,  or  is  a  lost  tool  or  object  that  is  not 
recovered  that  is  considered  “preventable”  (caused  by  maintenance  or  operations 
personnel). 

Appendix  AJ  indicates  that  DOP  counts  had  a  low-to-moderate  incidence  of 
negative  correlation  with  QA  manning  effectiveness  at  seven  of  14  bases  during  at  least 
one  lag  period.  Also,  FOD  counts  correlated  negatively  with  QA  manning  effectiveness 
at  eight  of  the  14  bases.  The  overall  analysis  of  the  DOP/FOD  count  correlations  is  that 
the  data  suggests  there  is  an  overall  low-to-moderate  linear  link  with  QA  manning 
effectiveness  rates.  We  will  next  perform  a  correlation  analysis  between  Material 
Deficiency  Report  counts  submitted  and  QA  manning  effectiveness  rates. 

Deficiency  Reports  (DR)  Count 

The  count  of  DRs  submitted  measures  the  number  of  instances  technicians  file 
material  deficiency  reports  on  defective  parts.  More  DRs  submitted  is  considered  better 
because  this  suggests  that  maintenance  personnel  are  being  proactive  in  trying  to  resolve 
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parts-related  trends.  Thus,  a  positive  correlation  with  QA  manning  effectiveness  is 
considered  GOOD  and  a  negative  correlation,  BAD. 

Examining  the  data  in  Appendix  AK,  we  find  that  four  of  the  14  bases  have  a 
moderate  positive  correlation  between  DR  counts  and  QA  manning  effectiveness  during 
at  least  one  lag  period,  and  that  eight  of  the  14  bases  have  a  moderately  negative 
correlation  during  at  least  one  lag  period.  The  overall  correlation  analysis  of  data  for 
DRs  Submitted  counts  does  not  support  an  ACC-wide  trend  but  may  indicate  local  trends 
for  some  of  the  bases.  We  now  perform  a  correlation  analysis  between  the  count  of 
Detected  Safety  Violation  Counts  and  QA  manning  effectiveness  rates. 

Detected  Safety  Violations  (DSV)  Count 

The  DSV  Count  metric  is  solely  a  QA  function.  These  are  counts  of  instances 
where  individuals  are  observed  by  QA  personnel  committing  unsafe  acts  (e.g.  a  person 
standing  on  the  top  step  of  an  A-frame  ladder,  or  not  wearing  protective  eyewear  when 
handling  caustic  liquids).  Although  a  low  count  of  detected  safety  violations  is 
intuitively  a  good  thing,  more  QA  manning  effectiveness  may  not  always  translate  into 
lower  incidents.  There  are  two  ways  to  interpret  these  phenomena:  (1)  the  more  effective 
QA  flight  will  catch  deficiencies  quicker  and  more  often  and  thus  a  higher  count  will 
result;  (2)  the  more  effective  QA  flight  will  tend  to  deter  these  personnel  from  taking 
shortcuts  and  thus  the  DSV  count  will  be  less.  Thus,  both  views  can  be  considered 
correct.  Now  we  will  proceed  to  the  analysis. 

The  data  in  the  correlation  table  in  Appendix  AM  for  DSV  counts  reveals  twelve 
of  14  bases  with  low-to-moderate  correlations  between  DSV  counts  and  QA  manning 
effectiveness  rates  (four  positively  correlated  and  eight  negatively  correlated).  And, 
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since  the  QA  management  team  at  the  unit-level  sets  the  tone  for  how  to  deal  with  DSVs, 
we  cannot  make  a  GOOD/BAD  ruling  from  the  limited  data  we  have.  However,  we  can 
make  a  reasonable  observation  and  say  that  the  data  seem  to  support  the  postulate  that 
DSV  counts  are  correlated  across  ACC  bases  as  a  function  of  QA  manning  effectiveness 
(see  Survey,  Part-1  Comments,  Appendix  F).  The  next  metric  we  will  examine  is  the  Fix 
Rate  metric. 

Fix  Rate  (FR)  Metric 

The  FR  metric  is  a  leading  indicator  showing  how  well  the  repair  process  is  being 
managed  and  is  an  excellent  tool  for  tracking  “ dead  time”  in  aircraft  repair  processes 
because  it  measures  the  speed  of  repair  and  equipment  maintainability  (AFI  21-101,  para 
1 .10.3.6).  The  FR  is  the  percentage  of  aircraft  landing  with  failures  that  are  returned  to 
flyable  status  within  a  designated  time  standard  (either  4,  8,  or  12-hours  depending  on  the 
type  of  aircraft).  The  mathematical  formula  is: 

, ,  Code3BreaksFixedWithinX-Hours 

FR(%)  = - *  1 00 

T  otalCode3Breaks 

This  is  another  metric  that  elicits  dichotomous  views  from  people  on  how  an  effective 
QA  flight  impacts  Fix  rates.  On  the  one  hand,  it  is  thought  that  a  more  effective  QA  will 
result  in  a  quicker  fix  time  because  technicians  will  tend  to  follow  technical  data  more 
closely.  The  opposing  view  is  that  a  more  effective  QA  flight  will  be  more  visible,  and 
thus  tend  to  slow  repair  processes  because  technicians  will  take  their  time  and  thus  take 
fewer  short  cuts  to  ensure  they  are  not  making  mistakes  or  missing  steps. 

The  data  in  the  correlation  table  in  Appendix  AH  for  Fix  rates  reveals  14  of  14 
bases  with  low-to-moderate  correlations  between  Fix  rates  and  QA  manning  effectiveness 
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rates  in  at  least  one  of  their  assigned  aircraft  units  during  at  least  one  lag  period  (ten 
positively  correlated  and  four  negatively  correlated).  And,  since  the  local  QA 
management  sets  the  tone  for  how  they  deal  with  technicians  working  jobs,  we  cannot 
make  a  GOOD/BAD  ruling  from  the  limited  data  we  have.  However,  we  can  make  a 
reasonable  observation  that  the  data  seems  to  support  the  postulate  that  Fix  rates  are 
correlated  across  ACC  bases  as  a  function  of  QA  manning  effectiveness  (see  Survey, 
Part-1  Comments,  Appendix  F).  The  next  metric  we  will  examine  is  Flying  Schedule 
Effectiveness  (FSE)  Rate. 

Flying  Scheduling  Effectiveness  (FSE)  Rate 

The  FSE  Rate  metric  is  a  leading  indicator  and  measures  how  well  the  unit 
planned  and  executed  the  weekly  flying  schedule.  Deviations  that  decrease  the  FSE  from 
100  percent  include:  scheduled  sorties  not  flown  because  of  maintenance,  supply, 
operations,  HHQ,  air  traffic  control,  or  other  causes.  This  measure  is  important  because 
disruptions  to  the  flying  schedule  can  cause  turmoil  on  the  flight  line  and  create  ripple 
affects  throughout  other  agencies  (AFI  21-101,  para  1.10.3.7).  The  mathematical 
formula  for  FSE  is: 


FSE(°/)  -  AdjustedSortiesSeheduledMinusChargeableDeviations 

Adj  ustedS  ortiesS  cheduled 

The  data  in  Appendix  AN  reveal  ten  of  14  bases  exhibited  low-to-moderate  positive 
correlations  between  FSE  rates  and  QA  manning  effectiveness  rates  in  at  least  one  of 
their  assigned  aircraft  units  during  at  least  one  lag  period  and  eight  bases  exhibited 
moderate  negative  correlations  between  FSE  rates  and  QA  manning  effectiveness  rates  in 
at  least  one  assigned  aircraft  unit.  An  overall  analysis  does  not  support  an  ACC-wide 
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trend  for  a  correlation  between  FSE  rates  and  QA  manning  effectiveness  levels  but 
several  bases  indicate  a  potential  relationship  (see  Survey,  Part-1  Comments,  Appendix 
F).  The  next  metric  we  will  examine  is  In-Flight  Emergency  Rate. 

In-Flight  Emergency  (IFE)  Rate 

The  IFE  Rate  metric  is  not  tracked  by  all  ACC  units  (in  this  study  Seymour- 
Johnson  and  Whiteman  do  not).  Although  not  considered  a  primary  metric,  it  is 
nonetheless  an  important  one.  The  mathematical  formula  is: 

IFE(%)  =  NumberInFlightEmergencies  *  1  QQ 
Number  S  ortiesFlown 

First,  when  it  comes  to  the  IFE  Rate  metric,  it  is  intuitive  that  fewer  is  better  and  thus  we 
would  want  to  see  a  negative  correlation  (i.e.  a  higher  QA  effectiveness  rate  with  a  lower 
IFE  rate  -  GOOD).  The  data  in  Appendix  AP  shows  that  seven  of  eleven  bases  that  track 
IFEs  exhibit  low-to-moderate  negative  correlations  between  IFE  rates  and  QA  manning 
effectiveness  rates  in  at  least  one  of  their  assigned  aircraft  units  during  at  least  one  lag 
period,  and  six  bases  exhibit  moderate  positive  correlations  between  IFE  rates  and  QA 
manning  effectiveness  rates  in  at  least  one  assigned  aircraft  unit  during  at  least  one  lag 
period.  An  overall  analysis  does  not  support  an  ACC-wide  trend  for  a  correlation 
between  IFE  rates  and  QA  manning  effectiveness  levels  but  several  bases  indicate  a 
potential  relationship.  The  next  metric  we  will  examine  is  the  Key  Task  List  Pass  Rate 
metric. 

Key  Task  List  (KTL)  Pass  Rate  Metric 

The  KTL  Pass  Rate  metric  is  a  direct  output  of  QA.  KTLs  are  QA  maintenance 
inspections  on  tasks  that  are  complex  or  that  affect  safety  of  flight.  Each  time 
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maintenance  accomplishes  a  KTL  task,  they  must  notify  QA  to  respond.  It  should  be 
noted  that  although  QA  has  directive  authority  to  waiver  their  evaluation  on  a  KTL  item 
on  a  limited  basis,  a  waiver  is  a  rare  exception  (as  it  should  be).  The  mathematical 
formula  for  the  KTL  Pass  rate  is: 

KTLPass(%)-  NumberKTLinspecIionsPassed  .[()0 
NumberKTLinspectionsPerfonned 

In  the  realm  of  KTL  pass  rates  relative  to  QA  manning  effectiveness,  there  are  again  two 
perspectives:  (1)  a  more  effective  QA  flight  will  be  tougher  when  performing  these 
critical  inspections  and  thus  the  KTL  Pass  rate  would  be  expected  at  least  initially  to  be 
lower,  and  (2)  the  more  effective  QA  Flight  will  influence  the  maintainers  to  take  their 
time  and  be  more  thorough  performing  tasks  before  calling  QA  out  to  inspect  their  work 
and  thus  the  KTL  Pass  rate  should  be  higher.  When  analyzing  the  data  in  the  correlation 
table  in  Appendix  AR,  we  find  nine  of  the  13  bases  that  track  KTLs  separately 
experienced  moderate  positive  correlations  between  KTL  Pass  rates  and  QA  manning 
effectiveness  rates  and  four  bases  had  low-to-moderate  negative  KTL  Pass  rate 
correlations  with  QA  manning  effectiveness.  Additionally,  what  is  interesting  about 
these  correlations  is  that  most  of  them  track  fairly  consistently  across  lags.  As  for  the 
overall  analysis  for  an  ACC-wide  trend  for  a  relationship  between  KTL  Pass  rates  and 
QA  manning  effectiveness,  there  is  a  dichotomy  of  results  with  some  bases  being 
positively  correlated  and  some  being  negatively  correlated  which  is  possibly  a  function  of 
local  QA  management  strategies  (see  Survey,  Part-1  Comments,  Appendix  F).  We  will 
now  examine  the  Mission  Capable  Rate  metric. 
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Mission  Capable  (MC)  Rate 

The  MC  Rate  metric  is  a  lagging  indicator  and  represents  a  broad  composite  of 
many  process  and  metrics.  According  to  AFI  21-101,  maintenance  managers 
experiencing  a  low  MC  rate  should  look  for  workers  deferring  work  to  other  shifts, 
inexperienced  workers,  lack  of  parts  from  supply,  poor  in-shop  scheduling,  high- 
cannibalization  rates,  or  training  deficiencies  (para  1.10.3.1 1).  Furthermore,  a  2001  Air 
Force  Institute  of  Technology  thesis  supported  the  fact  that  low  manpower  effectiveness 
at  the  worker  level  is  a  strong  predictor  of  lower  MC  rates  (Oliver,  2001).  But  how  do 
the  MC  rates  correlate  with  QA  manning  effectiveness  rates?  The  mathematical  formula 
for  the  MC  Rate  metric  is  (note:  B-type  hours  are  depot-maintenance  hours) 


MC(%)= 


FullyMissionCapableHours+PartialMissionCapableHours-BtypeHours 

PossessedHours 


*100 


The  data  reveal  ten  of  14  bases  exhibited  moderate  positive  correlations  between  MC 
rates  and  QA  manning  effectiveness  rates  in  at  least  one  of  their  assigned  aircraft  units 
during  at  least  one  lag  period  (see  Appendix  AG).  Furthermore,  six  bases  exhibited  low- 
to-moderate  negative  correlations  between  MC  rates  and  QA  manning  effectiveness  rates 
in  at  least  one  assigned  aircraft  unit  during  at  least  one  lag  period.  An  overall  analysis 
does  not  support  an  ACC-wide  trend  for  a  correlation  between  MC  rates  and  QA 
manning  effectiveness  levels  but  several  bases  do  indicate  a  potential  relationship.  The 
next  metric  we  will  examine  is  Maintenance  Scheduling  Effectiveness  Rate  metric. 

Maintenance  Scheduling  Effectiveness  (MSE)  Rate 

The  MSE  Rate  is  a  leading  indicator  and  measures  the  unit ’s  ability  to  plan  and 
complete  inspections  and  periodic  maintenance  on-time  according  to  the  maintenance 
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plan.  A  low  MSE  rate  may  indicate  a  unit  is  experiencing  turbulence  on  the  flight  line  or 
in  the  maintenance  shops  (AFI  21-101,  para  1.10.3.10).  The  mathematical  calculation  is: 

MSE(0/ )  -  NumberScheduledMaintenanceActionsCompletedOnTime  ;|!  ^ 
TotalNumberMaintenacneActionsScheduled 

The  data  in  Appendix  AN  reveal  nine  bases  with  low-to-moderate-to-high  positive 

correlations  between  MSE  rates  and  QA  manning  effectiveness  rates  with  six  bases 

having  low-to-moderate  negative  correlations.  Due  to  the  strength  of  some  of  these 

correlations,  the  data  suggests  a  potential  relationship  for  MSE  rates  and  QA  manning 

effectiveness  at  the  majority  of  ACC  bases  (see  Survey,  Part-1  Comments,  Appendix  F). 

The  next  metric  we  will  examine  is  Maintenance/Operations  Deviations  Count  metric. 

Maintenance/Operations  Deviations  (MX/Ops  Devs)  Count 

Although  the  MX/Ops  Devs  Count  metric  is  normally  a  ratio  of  the  number  of 

chargeable  times  an  aircraft  does  not  meet  its  take-off  window  (within  specific  timing 

standards)  to  the  number  of  sorties  scheduled,  our  data  was  acquired  by  counts.  Although 

the  nonnal  mathematical  formula  is: 


MXOpsDev(0/ )  NumberMXDeviations+NumberOperationsDeviations 

NumberSortiesScheduled 


*100 , 


we  consider  this  count  data  as  acceptable  for  the  purposes  of  our  study  since  we  are 
performing  a  “within  treatments  analysis”  (i.e.  we  are  correlating  each  unit’s  counts  with 
their  respective  QA  manning  effectiveness).  But  what  exactly  constitutes  a  MX/Ops 
Dev? 


A  MX/Ops  Dev  could  occur  for  any  number  of  reasons  attributable  to  either 
maintenance  or  operations  (e.g.  the  pilot  may  be  weather  restricted).  Furthermore,  since 
this  number  is  not  broken  out  for  maintenance  at  most  of  the  participating  units,  our  data 
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is  mixed  and  thus  any  results  cannot  be  linked  specifically  to  QA  manning  effectiveness. 
We  are  including  it  in  the  study  because  it  had  a  greater  than  fifty  percent  response 
measure  as  a  primary  impact  metric  from  the  subject  matter  experts  from  the  Phase-One, 
Delphi  survey. 

The  data  in  Appendix  AF  reveal  nine  of  14  bases  indicate  moderate  negative 
correlations  between  MX/Ops  Devs  counts  and  QA  manning  effectiveness  rates  in  at 
least  one  of  their  assigned  aircraft  units  during  at  least  one  lag  period.  Furthennore,  eight 
bases  exhibited  low-to-moderate  positive  correlations  between  MX/Ops  Devs  counts  and 
QA  manning  effectiveness.  An  overall  analysis  does  not  support  an  ACC- wide  trend  for 
a  correlation  between  MX/Ops  Devs  counts  and  QA  manning  effectiveness  levels  but 
several  bases  indicate  a  potential  relationship  (see  Survey,  Part-1  Comments,  Appendix 
F).  The  next  metric  we  will  examine  is  the  Personnel  Evaluations  Pass  Rate  metric. 

Personnel  Evaluations  (PE)  Pass  Rate 

The  PE  Rate  is  a  lagging  indicator  that  measures  the  ability  of  personnel  to 
perform  tasks  in  their  duty  position.  A  PE  occurs  when  QA  personnel  perform  an  over- 
the-shoulder  evaluation  of  a  technician  performing  a  task  or  part  of  a  task  for  which  the 
technician  being  inspected  is  trained  and  signed  off  for.  Master  Sergeant  Sansavera,  the 
Air  Education  Training  representative  attached  to  ACC/HQ  Training,  stated  that  the 
reported  QA  pass  rate  is  considered  as  a  key  measure  of  the  training  effectiveness  in  the 
field  (Sansavera,  2005).  Thus  we  are  using  this  as  our  proxy  variable  to  examine  the 
potential  impact  that  QA  manning  effectiveness  has  on  training  instead  of  using  other 
more  traditional  measures  such  as  number  of  personnel  in  overtime  training  or  Career 
Development  Course  Pass  rates.  The  PE  rate  is  mathematically  detennined  as: 
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....  NumberPersonnelEvaluationsPassed 

PEPass(%)= - *  1 00 

NumberPersonnelEvaluationAttempted 


The  data  in  the  PE  Pass  Rate  correlation  table  in  Appendix  AQ  reveal  seven  of  14  bases 
exhibited  moderate  to  high  positive  correlations  between  PE  Pass  rates  and  QA  manning 
effectiveness  rates  in  at  least  one  of  their  assigned  aircraft  units  during  at  least  one  lag 
period  (see  Appendix  AQ).  Furthermore,  seven  bases  exhibited  low-to-moderate 
negative  correlations  between  PE  Pass  rates  and  QA  manning  effectiveness.  An  overall 
analysis  does  not  support  an  ACC-wide  trend  for  a  correlation  between  PE  Pass  rates  and 
QA  manning  effectiveness  levels  but  several  bases  indicate  a  potential  relationship  (see 
Appendix  F).  The  next  metric  we  will  examine  is  Phase  Key  Task  List  Pass  rate. 

Phase  Key  Task  List  (Phase  KTL)  Pass  Rate 

The  Phase  KTL  Pass  Rate  metric  is  a  subset  of  the  overall  KTL  Pass  Rate 
examined  earlier  in  this  chapter.  It  is  calculated  in  the  same  fashion,  but  is  focused  solely 
on  the  results  of  QA  inspections  performed  on  aircraft  after  all  maintenance  is  completed 
and  before  the  aircraft  rolls  out  of  a  phase  dock  inspection.  Since  not  all  bases  in  the 
study  perform  Phase  Dock  QA  inspections,  we  aggregated  only  those  bases  that  track 
Phase  KTL  inspections  into  this  correlations  analysis.  From  the  table  in  Appendix  AR, 
we  find  that  five  of  the  13  bases  that  track  Phase  KTL  Passes  experienced  moderate 
negative  correlations  between  Phase  KTL  Pass  rates  and  QA  manning  effectiveness  (i.e. 
pass  rates  are  going  down  with  increased  QA  manning  effectiveness)  and  only  seven 
bases  had  low-to-moderate  positive  correlations.  Overall,  the  data  is  inconclusive  for  a 
command-wide  correlation  between  QA  manning  effectiveness  and  Phase  KTL  Pass  rates 
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(see  Survey,  Part-1  Comments,  Appendix  F).  We  will  now  examine  the  Quality 
Verification  Inspection  Pass  Rate  metric. 

Quality  Verification  Inspection  (QVI)  Pass  Rate 

The  QVI  Pass  Rate  metric  is  an  inspection  that  QA  personnel  perform  that  can 
cover  a  broad  array  of  processes.  It  could  be  an  inspection  on  a  completed  maintenance 
action  or  one  in  progress,  or  an  inspection  on  a  facility  or  on  an  equipment  item.  It  is  a 
macro-measure  of  unit  and  technician  performance  and  provides  an  overall  status  of 
maintenance  operations  and  compliance  with  directives.  It  is  calculated  as: 

QVIPass(%)=  NumberQVIsPassed  ,10(| 
NumberQVIsPerformed 

The  table  in  Appendix  AQ  reveals  nine  of  the  bases  having  a  moderate -to-high  positive 
correlation  between  QVI  Pass  rates  and  QA  manning  effectiveness  (an  increase  in  QA 
manning  effectiveness  is  accompanied  by  an  increase  in  QVI  Pass  rates).  Also,  five  of 
the  bases’  data  indicate  a  moderate-to-strong  negative  correlation  (an  increase  in  QA 
manning  effectiveness  is  accompanied  by  a  decrease  in  the  QVI  Pass  rate).  This  is 
interesting  because  it  could  be  signaling  that  the  QVI  trend  at  a  particular  base  may  be  a 
function  of  management  emphasis  and  organizational  dynamics  (see  Survey,  Part- 1 
Comments,  Appendix  F).  The  next  metrics  to  be  examined  are  the  Repeat  and  Recur 
Rates. 

Repeat  and  Recur  Rates 

Although  these  two  measures  are  tracked  separately  at  HQ  ACC/LGP,  AFI  21- 
101  does  not  break  them  out.  However,  since  we  have  the  data,  we  will  analyze  them 
separately  here.  The  mathematical  calculations  for  repeats  and  recurs  are  (respectively): 
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Repeat(%)  = 


TotalRepeats 


TotalNumberPilotReportedDiscrepancies 


=  100 


Recurs(%)  = 


TotalRecurs 


TotalNumberPilotReportedDiscrepancies 


=  100 


A  Repeat  is  when  the  same  malfunction  occurs  on  the  very  next  flight  after  it  was 
repaired  and  a  Recur  is  when  the  same  malfunction  for  which  an  aircraft  was  repaired, 
occurs  on  the  2nd  through  4th  flights.  According  to  AFI  21-101,  Repeat  and  Recur  rate 
metrics  are  leading  indicators  and  perhaps  the  most  important  and  accurate  measure  of 
the  unit ’s  maintenance  quality.  When  we  examine  the  Repeat  Correlations  table  in 
Appendix  AS,  we  find  that  ten  of  the  14  bases  have  at  least  one  aircraft  type  with  low-to- 
moderate  negative  correlations  between  Repeat  rates  and  QA  manning  effectiveness  rates 
and  seven  bases  with  low-to-moderate  positive  correlations.  When  we  examine  the 
Recur  correlations  table  (see  Appendix  AS),  we  discover  that  eleven  of  14  bases  have  at 
least  one  aircraft  type  with  negative  correlations  between  Recur  rates  and  QA  manning 
effectiveness  rates,  and  six  with  positive  correlations.  The  overall  analysis  suggests  that 
Repeat  and  Recur  rates  are  potentially  trended  with  QA  manning  effectiveness  levels  at 
the  majority  of  bases  in  the  study  (see  Survey,  Part-1  Comments,  Appendix  F).  The  next 
metric  to  be  examined  is  the  Safety  and  Technical  Violation  Count. 

Safety  and  Technical  Violation  (STV)  Count 

The  STV  Count  is  a  composite  metric  and  is  the  number  of  times  QA  personnel 
observe  either:  (1)  a  person  performing  an  unsafe  act  (DSV);  (2)  a  person  not  following 
technical  directives  (TDV);  or  (3)  an  unsatisfactory  condition  (UCR).  This  metric  is 
computed  in  the  same  way  as  DSVs  explained  earlier.  Like  the  QVI  Pass  rate,  it  is  a 
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macro-metric  and  gives  maintenance  managers  quick  feedback  to  enable  them  to  take 
immediate  corrective  measure  to  avoid  injury  or  damage  to  property. 

The  STV  correlations  table  in  Appendix  AL  reveals  that  eight  of  the  14  bases 
have  a  moderate-to-strong  negative  correlation  between  STV  counts  and  QA  manning 
effectiveness  while  six  bases  have  a  weak-to-moderate  positive  correlation  between  STV 
counts  and  QA  manning  effectiveness.  This  seems  to  suggest  that  there  is  a  relationship 
across  ACC  bases  for  STV  counts  relative  to  QA  manning  effectiveness  where  as  QA 
manning  effectiveness  increases,  the  STV  count  rate  declines  possibly  due  to  QA’s 
increased  presence  influencing  personnel  to  avoid  taking  shortcuts  (see  Survey,  Part- 1 
Comments,  Appendix  F).  The  next  metric  we  examine  is  the  Technical  Data  Violation 
Count. 

Technical  Data  Violation  (TDV)  Count 

The  TDV  count  is  a  subset  of  STV  counts  and  is  calculated  in  the  same  manner. 

A  TDV  occurs  when  an  individual  performs  a  task,  and  either  doesn’t  have  technical  data 
with  him/her,  or  fails  to  follow  the  procedures  according  to  the  technical  data.  Analysis 
of  the  data  in  Appendix  AM  reveals  that  eight  of  the  14  bases  have  a  moderate-to-strong 
negative  correlation  between  TDV  counts  and  QA  manning  effectiveness  while  only  five 
bases  have  a  weak-to-moderate  positive  correlation  between  TDV  counts  and  QA 
manning  effectiveness.  This  metric  is  behaving  consistently  with  the  STV  count.  This 
suggests  that  there  is  a  correlation  across  ACC  bases  for  TDV  counts  relative  to  QA 
manning  effectiveness  (i.e.  as  QA  manning  effectiveness  increases,  the  TDV  count  rate 
declines)  possibly  due  to  QA’s  increased  presence  influencing  personnel  to  avoid  taking 
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shortcuts  (see  Survey,  Part-1  Comments,  Appendix  F).  The  next  metric  to  be  examined 
is  the  Total  Non-Mission  Capable  for  Maintenance  Rate. 

Total  Non-Mission  Capable  for  Maintenance  (TNMCM)  Rate 
The  TNMCM  Rate  metric  is  a  lagging  indicator  and  is  considered  to  be  the  most 
common  and  useful  measure  for  determining  if  maintenance  is  being  performed  quickly 
and  accurately.  It  is  the  average  percentage  of  possessed  aircraft  that  cannot  complete 
their  primary  assigned  mission  due  to  main  tenance  reasons  (except  depot-type 
maintenance)  (AFI  21-101,  para  1.10.3.1 1.2).  The  correlation  table  in  Appendix  AG 
indicates  that  twelve  of  14  bases  exhibited  moderate-to-high  negative  correlations 
between  TNMCM  rates  and  QA  manning  effectiveness  rates  in  at  least  one  of  their 
assigned  aircraft  units  during  at  least  one  lag  period.  Furthermore,  five  bases  exhibited 
low-to-moderate  positive  correlations  between  TNMCM  rates  and  QA  manning 
effectiveness.  An  overall  analysis  suggests  that  there  is  a  negative  correlative  trend  for 
TNMCM  rates  and  QA  manning  effectiveness  levels  across  the  bases  under  study  (see 
Survey,  Part-1  Comments,  Appendix  F).  The  last  metric  we  will  examine  is  the 
Technical  Order  Improvement  Submitted  Count. 

Technical  Order  Improvement  Submitted  (TO  Imp  Submitted)  Count 
The  TO  Imp  Submitted  Count  metric  reflects  the  number  of  instances  where 
technicians  submit  TO  improvement  recommendations.  Like  the  DRs  Submitted  metric, 
the  TO  Imp  Submitted  metric  measures  the  proactive  level  of  personnel  within  a 
maintenance  organization.  Our  theory  is  that  the  more  technical  order  improvements  that 
are  submitted,  the  more  deeply  engaged  technicians  are  with  their  jobs.  Analysis  of  the 
correlation  table  in  Appendix  AK  reveals  a  dichotomous  split  between  and  among  the 


87 


ACC  bases  in  the  study  with  half  exhibiting  a  weak-to-moderate  positive  correlation 
between  TO  Imp  Submitted  and  the  calculated  QA  manning  effectiveness  and  the  other 
half  revealing  a  weak-to-moderate  negative  correlation  between  TO  Imp  Submitted  and 
the  calculated  QA  manning  effectiveness.  Now  that  we  have  examined  all  of  the 
indicated  metrics  for  a  possible  linear  relationship  with  QA  manning  effectiveness,  we 
conduct  one  last  test  to  detennine  any  significant  relationships  (see  Survey,  Part- 1 
Comments,  Appendix  F).  We  will  do  this  in  this  next  and  last  section  of  this  chapter  by 
employing  statistical  linear  regression. 

Regressing  the  Data 

In  order  to  detennine  linear  relationships  for  the  types  of  data  across  all  bases 
under  study,  we  perfonned  simple  linear  regressions  on  the  indicated  metrics.  Because 
we  are  seeking  an  interpretive  model  to  be  used  at  the  base  level,  we  aggregated  the 
delimited  data  in  metric  areas  containing  multiple  data  sets  across  all  assigned  aircraft 
units  at  each  base  to  get  an  average  measure  (i.e.  MC,  TNMCM,  Break,  etc.).  This 
enabled  us  to  describe  the  average  behavior  of  the  variable  across  multiple  aircraft  types. 
However,  the  count-type  data  did  not  require  this  transformation. 

We  arranged  the  data  into  columns  for  all  participating  ACC  bases  in  a 
contemporaneous  (no-lag)  format  with  each  base  and  then  ran  each  of  the  regressions  and 
analyzed  the  output  specifically  for  level  of  significance  and  direction  of  relationship. 
Although  we  had  several  metrics  with  respectable  R-squared  values,  the  degree  of  fit  is 
not  our  most  important  consideration.  This  is  because,  although  the  R-squared  value  is 
considered  as  a  prime  factor  when  determining  usefulness  of  a  predictive  model,  we  are 
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creating  interpretive  models.  Thus  R-squares  of  greater  than  0.05  were  considered  useful 
as  long  as  the  p-value  was  significant.  After  all,  we  can  not  reasonably  expect  to  have 
any  single  independent  variable  (in  our  case  QA  manning  effectiveness )  explain  all  of  the 
variation  for  any  of  the  dependent  metric  variables  in  the  study  -  there  are  just  too  many 
moving  parts  in  a  USAF  flying  unit.  However,  the  R-squared  values  do  provide  useful 
information  nonetheless.  One  final  concern  did  emerge  in  our  analysis. 

In  our  data  we  found  five  of  nine  metric  data  types  with  Durbin-Watson  test 
values  that  were  outside  of  the  normally  acceptable  level.  However,  according  to  Oxley, 
although  there  are  transformations  that  can  be  applied  to  the  data  to  try  and  eliminate 
this  condition,  it  may  not  always  be  successful  (Oxley,  2000).  In  our  study  we  understand 
a  priori  that  this  will  most  likely  be  the  outcome  since  our  data  is  serially  related. 
Furthermore,  recent  studies  indicate  that  even  when  heteroskedasticity  cannot  be 
eliminated,  valid  inferences  can  still  be  made  (Oxley,  2000).  Since  we  appended  our 
base-level  data  sets  into  a  single  file,  we  therefore  expect  serial  correlation  (see  Appendix 
BT).  This  may  bias  these  parameters,  but  Oxley  implies  that  it  will  not  affect  our  overall 
conclusions  because  it  affects  efficiency  instead  of  accuracy. 

Interpreting  the  Data 

The  QA  manning  variable  is  interpreted  as  an  elasticity  value  for  non-count 
dependent  metrics.  The  Elasticity  formula  is: 

E,  =^-»  —  =  (E=  expected  value:  A=the  change  in) 

y'x  AX  Y  %AX 
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So,  for  our  purposes,  a  one  percent  increase  in  the  QA  Manning  value  will  yield  a  0.7 
percent  decrease  in  the  break  rate.  This  also  holds  true  for  the  other  dependent  variables 
listed  in  Tables  22  and  23.  Conversely,  when  interpreting  the  impact  on  a  Count-type 
metric  (see  Table  24),  the  marginal  improvement  is  an  amount  (e.g.  a  -0.01  Dropped 
Object  incremental  change  means  that  a  100  percent  increase  in  QA  Manning 
Effectiveness  will  result  in  one  less  dropped  object  at  each  base).  Tables  25  and  26  show 
the  respective  compiled  information  for  rate  and  count  data  (also  refer  to  Appendixes  BW 
through  CG  for  regression  outputs). 

Table  22  -  Statistically  Significant  Metrics  (rates  -  part-1) 


Variable 

Break  (rate) 

CANN  (rate) 

Flying  Scheduling 
Effectiveness  (rate) 

Key  Task  List  Pass 
(rate) 

Intercept 

Coefficient 

4.087659*** 

6.074444*“ 

4.4521 

4.648305'“ 

t-stat 

11.74 

9.82 

46.2 

67.56 

QA  Manning 

Coefficient 

-0.007316*** 

-0.024384*** 

-0.003797*** 

-0.001474** 

t-stat 

-119 

-3.6 

-3.27 

■1.99 

FIGHTER  Dummy 

Coefficient 

-0.937653*** 

•1.772981'" 

0.259332'“ 

-0.036116*“ 

t-stat 

-114 

.774 

mm.J 

•7.36 

•3.01 

SPECIAL  Dummy 

Coefficient 

-1107385“* 

-3.115764*** 

0.177958'“ 

-0.032418 

t-stat 

•13.07 

-12.97 

-4.48 

-1.33 

Adjusted  R-squared 

0.45 

0.61 

0,24 

0.06 

F-statistic 

94.72749 

179.9844 

35.99621 

6.628953 

'  denotes  statistical  significance  to  the  0.1  level "  denotes  statistical  significance  to  the  0(15  level denotes  statistical  significance  to  the  0.01  leve 
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Table  23  -  Statistically  Significant  Metrics  (rates  -  part-2) 


Variable 

Maintenance  Schedule 
Effectiveness  (rate) 

Q VI  Pass  (rate) 

Repeat  (rate) 

Intercept 

Coefficient 

4.748972 

4.62219 

2.315238 

t-stat 

CO 

179.42 

3.44 

QA  Manning 

Coefficient 

-0.002095*** 

-0.001238*** 

-0.014351*** 

t-stat 

-6.17 

-4.23 

-1.95 

FIGHTER  Diunmy 

Coefficient 

0.002535 

-0.020465 

-0.318716 

t-stat 

0.46 

-4.01 

-3.72 

SPECIAL  Drnniny 

Coefficient 

-0.079813 

0.001102 

-0.001338 

t-stat 

-4.91 

0.13 

-0,004 

Adjusted  R-squaied 

0.1 

0.18 

0.05 

F-statistic 

14.05694 

26.91791 

7.512129 

*  denotes  statistical  significance  to  the  0.1  level,  **  denotes  statistical  significance  to  the  0.01  level,  ***  denotes  statistical  significance  to  the  0.01  level. 


Table  24  -  Statistically  Significant  Metrics  (counts) 


Variable 

Dropped  Objects  (count) 

Safety  Teduucal 
Violations  (count) 

Intercept 

Coefficient 

2.080573 

0.091283 

z-stat 

3.34 

0.2 

QA  Manning 

Coefficient 

-0.01058f 

2479759*** 

z-stat 

-1.59 

4.94 

FIGHTER  Dummy 

Coefficient 

-0.825581 

0.220037 

z-stat 

-6.62 

2.21 

SPECIAL  Dummy 

Coefficient 

-1.975846 

0.181072 

z-stat 

-5.83 

0.97 

Adjusted  R-squared 

0.14 

0.12 

|  denotes  statistical  significance  at  the  0.15  level;  *  denotes  statistical  significance  to  the  0.1  level,  **  denotes  statistical 
significance  to  the  0.05  level,  ***  denotes  statistical  significance  to  the  0.01  level. 
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Table  25  -  Compiled  Elasticities  for  RATE  Metrics 


Variable 

Elasticity 

Significance  Level 

Break 

-0.8 

0.0135 

C  annib  alization 

-2.6 

0.0001 

Flying  Schedule  Effectiveness 

-0.3 

0.0024 

Key  Task  List  Pass 

-0.1 

0.0628 

Maintenance  Scheduling 
Effectiveness 

-0.2 

0 

Quality  Verification  Inspection 
Pass 

-0.1 

0 

Repeat 

-1.4 

0 

Table  26  -  Compiled  Incremental  Changes  for  COUNT  Metrics 


Variable 

Incremental  Change 

Significance  Level 

Dropped  Objects 

-1.1 

0.1129 

Safety/Technical  Violations 

2.5 

0 

An  Example  Benefit  Cost  Analysis  Using  the  Dropped  Objects  Results 

A  thumbnail  benefit  cost  analysis  provides  some  guidance  on  the  role  of  QA  in 
reducing  costs  to  the  Air  Force.  This  example  assumed  an  annual  personnel  cost  of 
$75,000  for  each  QA  NCO  added.  Also,  note  that  the  result  of  adding  one  NCO  would 
be  a  four  percent  increase  in  QA  manning  effectiveness  until  the  QA  flight  reaches  100 
percent  manning  effectiveness.  Furthennore,  we  assumed  a  conservative  average 
dropped  object-cost  of  $2,000  per  event  (this  includes  all  costs  across  the  entire  value 
chain  -  cost  of  the  part,  the  investigation,  the  resultant  inspections,  etc.). 
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We  found  that  a  four  percent  increase  in  QA  manning  effectiveness  (adding  one 
NCO  to  each  base’s  QA  staff)  suggests  that  we  will  have  approximately  four  fewer 
dropped  objects  at  each  base.  When  applied  to  a  single  base,  this  translated  to: 

Annual  Dropped  Object  Savings  =  (-4.4DOPs)*16Bases)*(12Months)*($lK)  =  $1,689,600 

Next  we  calculated  the  costs  of  adding  one  NCO  to  each  base: 

NCO$$  All  Bases=($75000perNCO)*(16bases)=$  1 ,200,000 
Finally  we  divided  the  Dropped  Object  savings  by  the  cost  of  the  “additional”  personnel 
to  come  up  with  the  Benefit  Cost  Ratio: 

Benefit  Cost  Ratio  =  » •^9.600DQPsavings  =  UQ8 

$  1 ,200,000NCOcost 

Thus  with  a  1.408  benefit  cost  ratio  for  Dropped  Objects,  the  USAF  could  realize  an 
annual  savings  of  $489  Thousand.  This  example  alone  suggests  that  increasing  the  QA 
manning  effectiveness  (i.e.  assigning  one  more  NCO  to  each  ACC  base’s  QA  flight 
against  authorized  slots)  is  justified  solely  on  the  basis  of  decreasing  Dropped  Objects. 

Metrics  with  No  Direct  Statistical  Relationship  to  QA  Manning  Effectiveness 

Seventeen  of  the  metrics  that  the  subject  matter  experts  in  the  field  indicated  in 
Survey,  Part-1  that  might  be  impacted  by  QA  manning  effectiveness  were  found  not  to 
have  statistically  significant  relationships.  However,  even  though  these  metrics  did  not 
pass  the  regression  analysis,  they  should  not  be  ignored  by  management  (see  Table  27 
and  review  subject  matter  experts’  comments  in  Appendix  F). 
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Table  27  -  Metrics  Not  Statistically  Significant 


^Metrics  Not  Statistically  Significant 

Abort  (rate) 

Flight  Mishaps  (count) 

Maintenance  Operations 
Deviations  (count) 

Combined  Mishaps  (count) 

Foreign  Object  Damage 
(count) 

Personnel  Evaluations  Pass 
(rate) 

Deficiency  Reports  Submitted 
(count) 

Ground  Mishaps  (count) 

Phase  Dock  Key  Task  Listing 
Inspection  Pass  (rate) 

Detected  Safety'  Violations 
(count) 

In-flight  Emergencies  (count) 

Recur  (rate) 

Fix  (rate) 

Mission  Capable  (rate) 

Technical  Data  Violations 
(count) 

Technical  Order 
Improvements  Submitted 
(count) 

Total  Non  Mission  Capable 
for  Maintenance  (rate) 

Overview  of  the  Next  Chapter 

Chapter  VI  concludes  this  research  study  where  we  answer  the  three  investigative 
questions  and  the  research  question.  We  also  present  managerial  implications.  Finally, 
we  review  the  research  limitations  and  provide  recommendations  for  future  research. 
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VI.  Conclusions  and  Recommendations 


Introduction 

This  chapter  discusses  the  conclusions  drawn  from  the  research  by  addressing 
each  of  the  investigative  questions  (IQ)  that  will  in-tum  answer  the  research  question. 

We  will  then  present  managerial  implications  and  research  limitations  with  the  study. 
Lastly,  we  will  discuss  potential  areas  for  future  research. 

Findings 

This  section  answers  the  questions  posited  in  Chapter  I.  IQ-1  and  IQ-2  are 
answered  through  the  Delphi  survey  as  analyzed  in  Chapter  IV,  while  IQ-3  is  answered 
through  a  statistical  analysis  of  the  metric  data  indicated  in  Chapter  V. 

Investigative  Question  #1:  Which  key  unit-  and  wing-level  metrics  are  most 
affected  by  an  empty  QA  manning  position  or  a  mismatch? 

This  was  answered  through  a  Delphi  survey.  Thirty-four  field-  and  headquarters- 
level  subject  matter  experts  performed  a  computer-based  qualitative  survey  where  they 
indicated  on  a  six-point  LIKERT  scale  how  they  felt  the  aircraft/munitions  maintenance 
QA  function  impacted  each  of  fifteen  listed  metrics.  The  Delphi  panel  experts  were  then 
given  the  opportunity  to  provide  additional  metrics  which  they  felt  would  be  significantly 
impacted  by  QA  effectiveness.  The  results  were  then  aggregated  to  develop  a  candidate 
list  of  metrics  for  further  analysis.  In  the  analysis,  it  was  not  surprising  that  the  majority 
of  resultant  metrics  on  the  list  having  a  50  percent  or  greater  median  value  as  detennined 
by  the  Delphi  survey,  were  comprised  of  metrics  already  tracked  at  unit  and  headquarters 
levels  (see  Appendix  G  for  a  list  of  all  indicated  metrics  and  their  significance  levels). 
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Investigative  Question  #2:  What  is  the  effectiveness  of  a  person  without  the 
Unit  Manning  Document-authorized  Air  Force  Specialty  Code  (AFSC)  when 
performing  the  QA  duties  of  another  AFSC  (how  good  is  the  fit)? 

This  question  was  answered  through  a  Delphi  survey.  Thirty-two  subject  matter 
experts  completed  one  round  of  the  Delphi  survey  and  14  completed  two  rounds.  A 
supplemental  Delphi  survey  was  also  completed  to  account  for  AFSCs  that  were 
identified  as  new  information  after  the  initial  aggregation  of  manning  infonnation  from 
the  units  at  the  beginning  of  the  study.  Fourteen  subject  matter  experts  completed  this 
supplemental  survey.  The  result  was  the  creation  of  a  matrix  that  allows  maintenance 
managers  to  determine  with  some  confidence  the  potential  effectiveness  of  an  individual 
performing  in  a  QA  position  designated  for  an  AFSC  other  than  the  one  they  possess  (see 
Table  14).  This  tool  also  gives  the  maintenance  manager  the  ability  to  analyze  the  entire 
QA  flight  for  effectiveness  to  gain  an  overall  flight  manning  effectiveness.  We  did  this 
using  the  following  rules: 

1)  If  an  authorized  QA  manpower  position  was  filled  with  a  person  possessing  the 
AFSC  called  for  in  the  UMD,  the  position  effectiveness  was  rated  at  100  percent 
effective  (e.g.  a  person  with  AFSC  2A5X3  was  assigned  to  a  2A5X3  QA 
position). 

2)  If  the  person  filling  a  QA  position  possessed  an  AFSC  other  than  that  called  for  in 
the  UMD,  the  appropriate  effectiveness  level  derived  from  the  QA  manning 
effectiveness  charts  was  assigned  to  that  position  (e.g.  a  person  with  AFSC 
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2A5X3  was  assigned  to  a  2A5X1  QA  position  would  be  rated  at  an  effectiveness 
level  of  61  percent  as  derived  from  the  QA  Manning  Effectiveness  Matrix). 

3)  Instances  where  UMD  manpower  positions  were  double-filled  (i.e.  two  persons 
possessing  AFSC  2A3X3  were  assigned  against  one  UMD-authorized  2A3X3 
manpower  position),  were  rated  as  100  percent  effective.  The  rationale  for  this 
was  that,  although  not  authorized  for  in  the  UMD,  these  “extra”  personnel  provide 
capability  and  more  capability  “should  be  better”,  thus  proper  credit  should  be 
applied  to  possibly  offset  deficiencies  in  other  areas. 

4)  All  unfilled  QA  positions  were  rated  as  zero  percent  effective. 

The  results  of  this  analysis  were  then  applied  to  each  of  16  QA  flights’  historical 
manning  to  achieve  the  overall  by-month  manning  effectiveness  fit  for  a  24-month 
period.  We  applied  these  results  statistically  against  accumulated  metrics  for  data  types 
identified  in  Investigative  Question  1 . 

Investigative  Question  #3:  What  is  the  relationship  between  QA  manning 
effectiveness  and  the  key  unit  and  wing-level  metrics? 

This  question  was  answered  first  through  a  quantitative  correlation  analysis, 
together  with  a  qualitative  interpretation  using  time  lags  to  address  latent  variable 
characteristics.  We  first  performed  a  macro-level  analysis  on  unit-level  correlation 
relationships  between  each  of  the  dependant  variables  and  calculated  QA  manning 
effectiveness  at  each  base.  We  then  subjected  each  metric  data  type  to  a  cross-sectional 
statistical  analysis  across  all  16  participating  Air  Combat  Command  bases  to  detennine 
relationships. 
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The  statistical  regression  analysis  uncovered  nine  of  the  26  metrics  identified  by 
the  subject  matter  experts  in  the  Delphi  survey  as  being  statistically  significant  (see 
Tables  25  and  26).  We  then  performed  an  example  benefit  cost  analysis  for  changes  in 
QA  manning  effectiveness  as  they  related  to  Dropped  Objects.  This  analysis,  using 
hypothetical  cost  values,  presented  compelling  evidence  for  maintenance  managers  to 
scrutinize  each  decision  to  leave  a  manning  slot  empty,  or  to  install  a  person  with  the 
other  than  UMD-authorized  credentials  when  manning  individual  QA  positions.  These 
tradeoff  investigations  can  help  determine  which  management  mitigating  strategies  to 
employ  to  offset  these  potentialities. 

The  impact  that  maintenance  QA  has  on  key  unit-  and  wing-level  metrics  is 
summed  up  very  eloquently  in  the  following  e-mail  quote  from  one  of  our  maintainer 
experts  in  the  field: 

Chief  Moore, 

Concerning  our  phone  conversation  about  QA  Effectiveness,  I  would  like  to  voice 
an  opinion  I  have  from  22  years  of  aircraft  maintenance  experience.  I  have  worked 
as  a  ground  crew  member,  assistant  crew  chief,  crew  chief,  branch  trainer,  quality 
assurance  inspector,  shift  supervisor,  flight  chief  and  I  now  work  in  wing  safety 
preventing  FOD/  DOP  and  flight  related  mishaps.  I  know  the  playing  field  inside  and 
out.  I  have  felt  the  pain,  instilled  and  facilitated  it  concerning  quality  assurance,  and 
the  impact  it  has  on  the  aircraft  maintenance  community. 

Quality  Assurance ’s  presence  impacts  the  maintenance  community  by  instilling 
the  old  <stuff>  rolls  down  hill  theory.  When  Quality  Assurance  discovers  or  is 
informed  of  a  trend  that  is  not  I  AW  TO  guidance,  they  level  the  playing  field  by 
letting  the  units  know  that  they  will  be  putting  emphasis  on  that  area.  The  units 
respond  by  ensuring  the  area  is  in  compliance  with  AF  directives.  Any  breach  in  the 
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agreement  will  surface  quickly  as  QA  holds  up  their  end  of  the  bargain  by  identifying 
any  more  discrepancies.  Those  discrepancies  are  then  disseminated  by  the 
leadership  when  the  quality  inspection  result  is  presented  to  the  unit.  In  turn,  actions 
are  taken  to  correct  the  unsatisfactory  condition, 
v/r 

MSgt  Webb 

2  BW FOD/DOP  Prevention  NCO 

Recommendations  for  Action 

We  propose  the  following  recommendations  for  action.  Note  that  they  are  not 
without  interpretation  and  thus  should  not  be  followed  blindly. 

1)  Deploy  the  QA  Manning  Effectiveness  Matrix  and  instructions  to  field  QA  units 
to  enable  them  to  calculate  their  current  overall  QA  manning  effectiveness  rates. 

2)  Each  unit  could  use  the  effectiveness  matrix  on  an  individual  basis  to  detennine 
the  effectiveness  of  a  person  possessing  a  “mismatch”  AFSC  would  be  in  a  QA 
position.  This  will  enable  QA  managers  faced  with  recurring  shortfalls  to  make 
more  informed  decisions  when  assigning  personnel  from  high-demand,  low- 
density  specialties. 

3)  Each  unit  could  perform  an  analysis  of  their  key  unit-  and  wing-level  metrics  for 
presence  of  trends  or  to  uncover  areas  where  they  are  consistently  below 
standards. 

4)  To  uncover  useful  vectors  to  apply  management  attention  to,  each  unit  could 
perform  a  statistical  regression  through  their  analysis  shop  to  detennine  the 
strength  and  direction  of  any  linear  relationships  with  the  calculated  QA  manning 
effectiveness.  This  will  help  them  rule  in/out  low  QA  manning  effectiveness  as  a 
potential  contributing  factor  to  deficient  areas  indicated  by  their  metrics. 


99 


Future  Research 


Future  research  efforts  could  concentrate  on  performing  a  Benefit  Cost  Ratio 
analysis  with  other  military  or  civilian  organizations  with  high-demand,  low-density 
resources.  This  would  provide  unit  managers  with  empirical  data  to  support  manning 
decisions.  Also,  the  metric  relationships  that  were  indicated  in  the  study  could  possibly 
be  investigated  through  a  structural  equation  modeling  technique  to  uncover  potential 
additional  linkages.  Lastly,  this  methodology  could  be  applied  to  other  low-density, 
high-demand  functions  to  uncover  potential  impacts  in  order  to  develop  strategies  to 
mitigate  problems  before  they  can  occur  or  worsen. 
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Appendix  A:  Delphi  Computer-Based  Survey  -  Part-1 


Aircraft  Quality  assurance  manning  construct  Part  I 


Survey  Control  Number:  USAF  04-098 
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ei  generic  e  n  the  aircraft  and*o»  muntors  mertewance  mannng  area  In  this  <mb  survey,  we  are  asking  you  to  ubfcze  the 
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Appendix  B:  Delphi  Computer-Based  Survey  -  Part-2 
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Appendix  C:  Delphi  ROUND  TWO  Survey,  Part-2  E-mail  Instructions 


Sir/Ma’am, 

Let  me  first  thank  you  for  completing  the  FIRST  ROUND  of  this  DELPHI  study.  As  you 
know,  a  DELPHI  study  is  a  qualitative  procedure  in  an  attempt  to  get  subject  matter 
experts  to  gain  agreement  within  certain  statistical  bounds  on  a  subject  in  which  they 
are  expert.  We  have  analyzed  the  data  from  ROUND  ONE  and  found  sufficient 
statistical  difference  (specifically  the  coefficient  of  variation)  on  most  ratings  amongst  all 
PANEL'S  experts  to  perform  a  SECOND  ROUND.  The  attached  EXCEL  file  contains  4 
matrix  sheets  (Matrix  #1,  #2,  #3,  and  #4).  Each  sheet  has  3  tables  on  it:  (1)  Working 
Matrix  of  Group  Mean  Ratings  —  Out  of  Limit  Ratings ;  (2)  How  You  Rated  —  Round 
# 1 ;  (3)  Means  for  All  Panel  Member  Ratings.  The  basic  instructions  for  completing 
this  DELPHI  SECOND  ROUND  is  to  analyze  the  aggregate  results  from  the  top  table  on 
each  <Matrix>  sheet  against  your  ratings  from  ROUND  ONE  (your  data  is  provided  in 
the  middle  table  labeled  "How  You  Rated  —  Round  #1"),  and  adjust  your  ratings  as  you 
deem  appropriate.  Please  ensure  to  make  all  adjustments  to  the  top  table  on  each  matrix 
page.  On  the  EXCEL  file  there  are  two  other  sheets:  (1)  AFMAN  36-21 08  AFSC  Duty 
Peso  and  (2)  Base  Files.  The  AFMAN  36-2108  sheet  has  all  of  the  job  descriptions  for 
all  of  the  AFSCs  on  the  survey.  You  can  disregard  the  <Base  Model>  sheet  —  it  is 
included  because  it  is  necessary  for  all  of  the  links  to  work  within  the  file.  I  have  also 
attached  a  separate  word.doc  file  with  detailed  instructions  on  how  to  complete  the 
survey.  Lastly,  I  sincerely  apologize  but  due  to  the  tremendous  amount  of  time  ROUND 
ONE  took,  ROUND  TWO  will  have  to  be  completed  and  sent  back  to  me  by  COB  24 
Dec  04. 

Vr 

CMSgt  Moore 
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Appendix  D:  Delphi  ROUND  TWO  Survey,  Part-2  Instructions 


AFSC  Fit  Matrix  for  Aircraft  QA 

Survey  Control  Number:  USAF  04-098 


Privacy  Notice 


The  following  information  is  provided  as  required  by  the  Privacy  Act  of  1974: 

Purpose:  To  obtain  information  regarding  potential  effects  of  manning  assignment 
practices  within  USAF  Aircraft  Quality  Assurance  (QA)  flights.  You  have  been 
identified  as  a  person  with  a  wide-breadth  of  experience  in  the  aircraft  and/or 
munitions  maintenance  manning  arena  and  further,  you  have  already  voluntarily 
completed  ROUND  ONE  of  Survey,  Part-2.  This  is  ROUND  TWO  of  the  survey  and 
we  are  asking  you  to  analyze  the  aggregated  responses  from  ROUND  ONE  and  make 
changes  as  you  see  fit.  Please  use  the  0%  to  100%  rating  scale  and  evaluate  how 
well  a  “typical”  person  holding  each  of  the  listed  AFSCs  would  reasonably  be 
expected  to  perform  the  duties  of  a  person  in  each  of  the  listed  AFSC  QA  positions. 
For  example,  a  dog  trainer  might  perform  the  duties  of  a  cat  trainer  at  an 
effectiveness  level  ‘20%’  where  a  dog  trainer  would  perfonn  the  duties  of  a  dog 
trainer  at  an  effectiveness  level  ‘100%’  (note:  0%  =  Totally  Ineffective  ;  100%  = 
Totally  Effective  ). 

Routine  Use:  The  survey  results  will  be  used  to  assist  aircraft  maintenance  managers 
when  making  QA  manning  decisions.  A  final  report  will  be  provided  to  participating 
organizations.  No  analysis  of  individual  responses  will  be  conducted  and  only 
members  of  the  Air  Force  Institute  of  Technology  research  team  will  be  permitted 
access  to  the  raw  data. 

Participation:  Participation  is  VOLUNTARY.  No  adverse  action  will  be  taken 
against  any  member  who  does  not  participate  in  this  survey  or  who  does  not  complete 
any  part  of  the  survey. 
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Instructions 


•  Base  your  answers  on  your  own  thoughts  &  experiences. 

•  This  attached  EXCEL  file  uses  your  DELPHI  Panel  Member  number  and  is 
personalized  with  your  responses  from  ROUND  ONE.  It  is  your  file  and 
only  you  can  fill  it  in! 

•  Open  the  EXCEL  file  labeled  with  your  assigned  DELPHI  Member  number. 
Then,  click  on  <Matrix  #1>  sheet  at  the  bottom  of  the  page.  Go  through  the  top 
table  on  this  page  and  analyze  the  DELPHI  Panel  Group’s  MEAN  statistical 
ratings  from  ROUND  ONE.  Compare  these  MEAN  ratings  against  your  ratings 
from  ROUND  ONE  that  appear  in  the  middle  table  on  the  same  sheet.  Make  all 
changes  to  the  top  table  only.  The  third  and  bottom  table  on  the  sheet  contains 
all  of  the  DELPHI  Panel  Group’s  MEAN  statistical  ratings  from  ROUND  ONE 
(Note:  this  table  is  provided  for  your  information  only  because  some  of  the  top 
table’s  cells  are  darkened  in  and  locked  out  due  to  their  statistical  significance. 
The  top  table’s  cells  with  percentages  have  statistical  differences  across 
DELPHI  Panel  responses  and  can  be  adjusted. 

•  Your  ROUND  ONE  data  is  provided  in  the  table  labeled  ”How  You  Rated  — 
Round  #T'  (NS  in  a  cell  means  No  Score  was  given  in  ROUND  ONE).  Please 
note  that  you  can  provide  an  AFSC  combination  rating  on  ROUND  TWO  even 
if  you  did  not  provide  one  in  ROUND  ONE. 

•  The  ratings  in  the  top  table  are  the  statistical  MEANS  of  how  all  DELPHI  Panel 
Experts  rated  each  of  the  AFSC  combinations.  These  subjective  ratings  indicate 
how  effective  the  group  feels  a  “typical”  person  with  the  AFSC  appearing  down 
the  left  side  would  be  if  assigned  to  the  QA  AFSC  position  that  intersects  that 
cell  from  the  top  row  of  AFSCs. 

•  In  ROUND  ONE,  we  used  a  rating  scale  of  0,  1,  2,  3,  4,  and  5  which  translated 
to  0%,  20%,  40%,  60%,  80%,  and  100%  respectively.  In  ROUND  TWO,  these 
ratings  have  been  converted  to  “percentages  of  effectiveness”  in  order  to 
“tighten  up”  the  data  and  give  rating  flexibility. 

•  Where  the  same  AFSC  from  the  left  column  (Y-axis)  and  QA  AFSC  position 
from  across  the  top  of  the  table  (X-axis)  intersect  within  the  table,  they  are 
darkened  out  in  the  top  table  and  are  marked  as  100%  Totally  Effective  in  the 
middle  and  bottom  tables. 

•  Remember,  these  are  personnel  performing  duties  of  personnel  in  a  “typical” 
aircraft/  munitions  QA  flight.  Do  not  rate  personnel  as  if  they  were  performing 
normal  duty  tasks  as  they  would  when  assigned  to  a  MX  squadron,  MSA,  or  a 
flight  line  AMU. 

•  Note:  the  2A590  AFSC  is  a  feeder  to  the  2A300  Chief  Enlisted  Manager  (CEM) 
AFSC.  The  2A3X0  and  2A6X0  AFSCs  are  9-level  or  CEM  positions;  all  others 
are  5  or  7-level  positions.  Rate  all  AFSCs  in  the  aggregate  (i.e.  no  difference 
between  a  ‘5‘  and  ‘7’  or  ‘9‘  and  ‘0’  levels). 
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•  When  filling  in  the  table  with  percentage  effectiveness  ratings,  evaluate  them 
against  what  you  understand  encompasses  the  whole  AFSC  duty  position  and 
not  just  AFSC-specific  tasks  (i.e.  in  some  QA  flights,  an  avionics  technician 
‘might’  perform  APG  task  inspections,  assist  in  Weight  and  Balance  operations, 
and/or  evaluate  drop-tank  build-up  operations  besides  only  inspecting  avionics- 
type  tasks). 

•  Each  table  cell  has  a  comment  that  appears  if  you  pass  the  pointer  over  each  cell 
or  click  on  the  cell.  The  comment  refers  to  how  effective  a  person  with  the 
AFSC  from  the  left  column  (Y-axis)  would  be  if  assigned  to  the  QA  AFS  duty 
position  from  the  top  row  (X-axis).  Each  cell  has  its  own  specific  comment  -  no 
two  comments  are  the  same.  (NOTE:  the  ‘comment’  may  mislead  you  if  you 
just  use  the  arrow  buttons  for  navigation  within  the  table  —  you  have  to 
<click>  on  each  cell).  This  will  help  you  get  through  faster  {e.g.  Crew  Chief 
(Non-Tac  Acft)  Jymn/Crftmn  effectiveness  in  Structural  MX  Jymn/Crftmn  QA 
Position} . 

•  If  you  are  not  familiar  with  a  particular  AFSC,  leave  that  cell  blank. 

•  After  completing  sheet  <  Matrix  #1>,  click  on  and  open  up  the  sheets  labeled 
<Matrix  #2>,  <Matrix  #3>,  and  <Matrix  #4>  one  at  a  time,  in  numerical 
order,  and  complete  each  of  the  top  tables  using  the  same  criteria  and  procedures 
you  used  on  sheet  <Matrix  #1>. 

•  E-mail  the  completed  EXCEL  file  back  NLT  COB  24  Dec  04  to  the 

RESEARCHER  ONLY. 
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Appendix  E:  Delphi  ROUND  TWO  Survey,  Part-2  Instrument 


Results 


Average  Total  Years  in  Aircraft/Munitions 
Maintenance  =  20 


Working  Matrix  of  Group  Mean  Ratings  Out  of  Limit  Ratings  (any  block  not  shaded  out  is  out  of  statistical  limit) 
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Appendix  F:  Historical  Manning  Spreadsheet  Sent  Out  to  ACC  QA  Flights 


Jan  D3 

Fell  113 

Mai  03 

Api  03 

Me 

03 

Jim  03 

Jill  03 

Aug  03 

Sep  03 

Oct  03 
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Assn’d 

Auth'd 

Assn'd 

Auth'd 

Assn'd 
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Assn'd 
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Auth'd 

Assn'd 

Auth'd 

Assn'd 
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2A300 

2A300 

2A300 

2A300 

2A300 

2A300 

2 

0311002 

2A571 

2A671 

2A571 

2A571 

2A571 

2A571 

2A571 

2A571 

2A571 

24571 

3 

0311003 

24671 A 

2A671A 

2A671A 

2A671A 

2AE71A 

2A671A 

2A671A 

2A671A 

2A671A 

2A671A 

4 

0311004 

2A671A 

NA 

2A671A 

NA 

2A671A 

NA 

2A671A 

2A671A 

2A671A 

2A671A 

5 

0311005 

2W271 

2W271 

2W271 

2W271 

2W271 

2W271 

2W271 

2W271 

2W271 

2W271 

6 

0311006 

2W151 

2W171 

2W151 

2W171 

2W151 

2W171 

2W151 

2W171 

2W151 

2W171 

7 

0311007 

2W251 

2W271 

2W251 

2W271 

2W251 

2W271 

2W251 

2W271 

2W251 

2W271 

8 

0311007 

2W251 

2W251 

2W251 

2W251 

2W251 

2W251 

2W251 

2W251 

2W251 

2W251 

9 

0311008 

24590 

24571 

2A590 

2A571 

2A590 

2A571 

2A590 

2A571 

2A590 

2467 1 

10 

0311008 

2A590 

2A571 

2A590 

2A571 

2A590 

2A571 

2A590 

2A571 

2A590 

24671 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

Jan  D4 

Fell  D4 

Mar  '04 

Api  '04 

May 

04 

Jim  04 

Jill  04 

An 

04 

Sep  ‘04 

Oct  04 

Nov  04 

Dec  04 

MPN 

Auth'd 

Assn'd 

Auth'd 

Assn'd 

Auth'd 

Assn'd 

Auth'd 

Assn'd 

Auth'd 

Assn'd 

Auth'd 

Assn'd 

Auth'd 

Assn'd 

Auth'd 

Assn'd 

Auth'd 

Assn'd 

Auth'd 

Assn'd 

Auth'd 

Assn'd 

Auth'd 

Assn'd 

1 

0311001 

2 

0311002 

3 

1)311003 

4 

1)311004 

5 

0311005 

6 

'0311006 

7 

1)311007 

El 

1)311008 

9 

10 

11 

12 

13 

14 

15 

10 

17 

10 

19 

20 

21 

22 

Instiiictions: 


(1)  Fill  in  the  MPNs  front  your  UMD. 


(2|  Fill  in  the  Authorized  (Auth'd)  AFSC  fiom  the  UMD. 


(3)  Fill  in  the  AFSC  of  the  person  who  was  Assigned  (Assgn'd)  to  that  slot  <lniiii«|  that  period. 


(4|  Save  .mil  e-mail  back  to  the  leseaicher  (teiiymiooieg'afit.edu). 


Note:  The  entries  above  are  example  entries  only  --  please  delete  them  before  you  fill  in  your  actual  data.  Other  things  to  note  are  that  you  should  consider  a  person  assigned  for  the  whole  month  if  they  were  in  QA  for 
the  majority  of  the  month.  Also,  if  you  had  no  one  assigned  to  a  slot  during  a  period,  note  this  with  N-A  in  the  "Assn'd"  cell.  If  you  have  personnel  "double-slotted"  against  a  UMD  MPN  position  during  a  period,  indicate 
this  by  using  the  same  MPN  as  many  times  as  needed  and  filling  in  the  AFSC  of  the  person  who  was  assigned  to  each  of  the  slots.  Lastly,  each  of  the  units  understudy  have  differing  numbers  of  personnel  authorized 
and  assigned  and  this  is  why  only  20  lines  were  provided  to  fill  in  your  manning.  If  more  are  needed,  place  your  cursor  over  the  vertical  EXCEL  axis  at  a  position  where  you  want  to  add  lines,  right  click  the  mouse,  and 
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Appendix  G:  Delphi,  Survey  Part-1  Results 
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01:  The  overall  impact  of  work  performed  by  aircraft  maintenance  Quality  Assurance  personnel  as  a  whole  is  related  to  having  the  correct 
AFSCskill  levels  assigned  to  the  designated  Unit  Manpower  Document  positions. 

01  |6|4|6|5|5|6|6  |4|4|6|6|5|4|6|4|5|2|5|4|6|6|5|6l5|6|3|6|5|6|6|6|5|5|l|  I  5.00  I  80.0%  I  1.23  I  1.52  I  0.25 


Inspectors  do  cross  lines  and  inspect  other  AFSCs  with  additional  task  training.  Except  2W1  which  by  AFI  are  not  allowed  to  he  inspected 
by  other  AFSCs. 

What  they  inspect,  how  much  they  inspect,  how  much  they  analyze,  how  much  they  interface  with  mx  analysis,  training,  the  PIM,  AFETS, 
MXG  SO  leadership,  and  additional  duties  also  are  directly  related  to  the  overall  impact  OA  makes,  not  just  the  right  people  in  the  right 
positions. 

I'd  agree  whole  heartedly  IF  our  manpower  was  sufficient. 

This  is  paramount  in  being  able  to  properly  implement  MSEP  program  and  properly  surveil  the  maintenance  actions  that  aie  occurring  on 
the  flight  line  or  within  the  hack  shop  maintenance  facilities. 


While  the  correct  AFSC  skill  level  mix  is  important,  so  is  the  proper  numbers  of  a  given  AFSC  or  having  a  good  plan  for  CUT  training. 


The  impact  of  woik  is  more  closely  related  to  having  the  right  mix  of  AFSCs  assigned  to  OA.  This  is  not  necessarily  a  function  of  what  the 
UMD  shows.  It's  dependent  on  what  OA  is  trying  to  accomplish  and  the  skill  sets  and  experience  the  individuals  assigned  to  OA  bring. 

As  it  applies  to  nuclear  weapons  maintenance  OA. _ 

Right  amount  of  experience  is  essential  to  be  an  effective  inspector. _ 

The  work  in  which  OA  performs  does  not  align  with  the  number  or  AFSCs  assigned  to  OA.  These  leads  to  cut  training  OA  personnel  to 
perform  all  task  assigned  to  the  workcenter  especially  to  cover  TDYs  and  deployments 
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02: 

ACC  aircraft  unit  wing  Ground  Abort  rates  are  affected  by  the  quality  of  work  performed  by  aircraft  maintenance  Quality  Assurance 

personnel. 

02 

1 4 1  4  |5|4|5|2|  4  |3|4|3|4|4|6|3|3|4|4|4|2|1 16|4|6|2|6|4|4|5|4|2|4|5|3|4| 
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1.50 
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The  B-1  is  a  different  aircraft  from  previous  aircraft. 


It  all  depends  on  the  willingness  of  the  inspectors  to  assist  the  units  when  they  see  problems  about  to  arise.  Some  units  do  not  need  OA  to 
ensure  they  have  a  strong  abort  rate  while  others  could  very  well  benefit  from  their  inputs.  Unit  manning  composition  also  has  a  big  affect 
on  the  success  of  a  unit's  maintenance  indicators. 

Their  are  times  when  quality  of  maintenance  could  have  not  prevented  a  ground  abort. 

OA  personnel  at  barksdale  do  not  perform  maintenance  on  acft.  But  through  their  inspection  process  it  could  have  a  slight  positive  impact 
on  ground  aborts. 

I  only  agree  from  the  work  our  PIM  guys  do.  Our  trend  analysis  work  Inis  identified  hydraulic  problems  and  fixes  which  will  help  decrease 
ground  aborts. _ 

Ground  Aborts  before  crew  show  would  be  influenced  more  by  this,  such  as.  hydraulic  leaks  and  fuel  leaks  that  would  be  found  during  a 
OA  follow-up  inspection. 

Generally  most  breaks  aie  related  to  the  maintenance  actions  (i.e..  repair  servicing)  that  were  previously  peiformed.  The  maintenance 
repairs  are  extensive  that  it  would  not  be  apparent  to  any  qualified  OA  inspector  to  denote  there  was  a  potential  issue  to  begin  with. 
Howevei.  indirectly  through  the  Quality  Verification  Inspections  that  the  OA  inspectors  performs  via  the  MSEP  Program.  I  would  say  the 
Ground  Abort  rates  improve. 

Quality  Assurance  personnel  do  not  perform  hands  on  maintenance  while  assigned  to  Quality  Assurance  positions. 


I  think  the  way  the  question  should  be  ask  is  how  much  does  OA  evaluations  affect  and  or  influence  unit  wing  rates.  OA  does  not  do  a  lot 
of  hands-on  maintenance.  And  maybe  I'm  missing  your  intent,  but  I'll  answer  assuming  the  question  is  based  on  evaluations  not  hands-on. 


Went  through  all  the  questions  and  can't  really  answer  as  they  pertain  mainly  to  flight  line  maintenance.  But  I  will  offer  you  my  opinion  on 
OA  as  a  whole.  I  believe  that  if  the  maintenance  sections  have  a  quality  training  certification  program  and  quality  maintenance  is 
enforced  by  supervisors  then  re-enforced  by  OA  then  all  your  rates  will  be  affected  in  a  positive  way.  So  in  that  respect  I  agree  that  OA 
affects  ground  abort,  IFE,  hung  ordnance,  tire  FOD,  etc... 


Most  ground  aborts  (about  90%)  are  attributed  to  power  on  system  component  LRU  failures  that  wouldn't  be  detected  by  OA.  Perhaps  5%  to 
10%  of  physical  conditions  i.e.  cracked  panels,  could  be  prevented  or  minimized  but  only  by  100%  preflight  follow  up  OVIs.  Not 
realistic  feasible.  Most  aborts  are  component  system  failures  found  during  engine  run  or  power  on  condition.  Only  by  having  KTL  on 
preflight  would  I  say  that  OA  would  impact  ground  aborts,  and  then  maybe  10%  from  physical  visual  conditions,  i.e.  cracked  panels 

This  falls  on  the  maintenance  personnel  fixing  the  aircraft  and  aircraft  reliability.  OA  only  sees  a  sampling  of  the  maintenance  being 
performed.  They  can,  however,  address  abort  trends  and  help  curve  the  trends  through  training. 

In  many  case  OA  do  not  find  out  of  the  ground  abort  until  after  the  fact  and  in  many  case  do  not  find  out  at  all.  Leading  to  poor  corrective 
actions  and  few  training  opportunities 
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03:  ACC  aircraft  unit  wing  In-Flight  Emergency  Abort  rates  are  affected  by  the  guality  of  work  performed  by  aircraft  maintenance  Ouality 
Assurance  personnel. 


03  |4|4  |5|5|5|2|4  1 3 1 4 1 3 1 4 1 3 1 5 1 3 1 3 1 4 1 4 1 4 1 2 1 1  1 4 1 4 1 6 1 2 1 6 1 2 1 3 1 5 1 4 1 6 1 4 1 4 1 3 1 4 1  |  3.79  |  55.9%  |  1.20  |  1.44  |  0.32 

It  all  depends  on  the  willingness  of  the  inspectors  to  assist  the  units  when  they  see  problems  about  to  arise.  Some  units  do  not  need  OA  to 
ensure  they  have  a  stiong  abort  rate  while  others  could  very  well  benefit  from  their  inputs.  Unit  manning  composition  also  has  a  big  affect 
on  the  success  of  a  unit's  maintenance  indicators. 

Systems  do  fail  in-flight  due  to  wear. 

OA  personnel  at  barksdale  do  not  perform  maintenance  on  acft.  But  through  their  inspection  process  it  could  have  a  slight  positive  impact 
on  in-flight  emergency  abort. 


I  think  the  way  the  question  should  be  ask  is  how  much  does  OA  evaluations  affect  and  or  influence  unit  wing  rates.  OA  does  not  do  a  lot 
of  hands-on  maintenance.  And  maybe  I'm  missing  your  intent,  but  I'll  answer  assuming  the  question  is  based  on  evaluations  not  hands-on. 


Generally  most  breaks  are  related  to  the  maintenance  actions  (i.e..  repair  servicing)  that  were  previously  performed.  The  maintenance 
repairs  are  extensive  that  it  would  not  be  apparentto  any  qualified  OA  inspector  to  denote  there  was  a  potential  issue  to  begin  with.  OA 
inspectors  DO  NOT  perform  maintenance.  However,  indirectly  through  the  Ouality  Verification  Inspections  that  the  OA  inspectors  performs 
via  the  MSEP  Program.  I  would  say  the  Ground  Abort  rates  improve. 

The  B-1  is  a  different  aircraftfrom  previous  aircraft. 


Again.  OA  personnel  are  the  MXG/CC  eyes  and  ears  on  the  flightline.  Therefore  these  rates  are  not  directly  influenced  by  OA  personnel. 


I  think  the  way  the  question  should  be  ask  is  how  much  does  OA  evaluations  affect  and/or  influence  unit  wing  rates.  OA  does  not  do  a  lot 
of  hands-on  maintenance.  And  maybe  I'm  missing  your  intent,  but  I'll  answer  assuming  the  question  is  based  on  evaluations  not  hands-on. 


KTL  items  do  provide  the  last  look  at  those  critical  maintenance  tasks  that  if  accomplished  improperly  could  very  well  lead  to  IFE 
conditions  if  left  undetected.  KTL  inspections  do  prevent  those  critical  tasks  that  if  improperly  conducted  detected  could  lead  to  IFEs. 

This  falls  on  the  maintenance  personnel  fixing  the  aircraft  and  aircraft  reliability.  OA  only  sees  a  sampling  of  the  maintenance  being 
performed.  They  can.  however,  address  abort  trends  and  help  curve  the  trends  through  training. 

In  many  case  OA  do  not  find  out  of  the  ground  abort  until  after  the  fact  and  in  many  case  do  not  find  out  at  all.  Leading  to  poor  corrective 
actions  and  few  training  opportunities 
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04:  ACC  aircraft  unit  wing  Aircraft  Hung  Ordnance  rates  are  affected  by  the  quality  of  work  performed  by  aircraft  maintenance  Ouality 
Assurance  personnel. 
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In  most  units  I've  seen.  OA  2W1s  don't  get  involved  with  the  troubleshooting  of  weapon  release  systems  nor  with  supervisory  inspections 
prior  to  flight  thus  they  aren't  exposed  to  deficiencies  that  might  cause  a  hung  munition. 


OA  personnel  at  barksdale  do  not  perform  maintenance  on  acft.  OA  does  not  inspect  weapons  loads. 


Generally  Nellis  aircraft  hung  ordnance  is  related  to  old  carts  that  are  no  longer  used  by  the  CAF  but  have  been  deemed  suitable  for 
training  bases. 


More  affected  by  the  quality  of  training  received  in  the  load  barn. 


OA  AMMO  inspectors  do  inspect  weapons  configuration  prior  to  line  delivery. 


I  think  the  way  the  question  should  be  ask  is  how  much  does  OA  evaluations  affect  and/or  influence  unit  wing  rates.  OA  does  not  do  a  lot 
of  hands-on  maintenance.  And  maybe  I'm  missing  your  intent,  but  I'll  answer  assuming  the  question  is  based  on  evaluations  not  hands-on. 


WSS  plays  a  more  bigger  influence  here  but  both  can  train  mentor.  Also  system  reliability  factors  in. 


We  accomplish  mote  R&R  foi  hung  munitions  without  finding  the  root  causes. 
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05:  ACC  aircraft  unit  wing  Aircraft  Dropped  Object  rates  are  affected  by  the  quality  of  work  peiformed  by  aircraft  maintenance  Ouality 
Assurance  peisonnel. 

05  |5|3  |4|3|5]2|5  |3|2|4|4|5|4|1|5|4|4|3|2|1|5|5|6|2|5|4|4|5|4|2|4|5|3|4|  |  3.74  |  54.7%  |  1.29  |  1.66  |  0.34 

Many  drop  object  accrue  from  material  failure. _ 

OA  personnel  at  barksdale  do  not  perform  maintenance  on  acft.  But  through  their  inspection  process  it  does  have  a  positive  impact  on 
Aircraft  Dropped  Object. 

Generally  most  aircraft  dropped  objects  are  related  to  the  maintenance  actions  (i.e.,  tacked  panels)  that  weie  previously  peiformed.  The 
maintenance  actions  were  such  that  it  would  not  he  appaientto  any  qualified  OA  inspector  to  denote  theie  was  a  potential  issue  to  begin 
with.  Normally,  the  last  line  of  defense  on  preventing  a  dropped  object  is  the  person  that  performed  the  Exceptional  Release  and/or  the 
technicians  performing  end  of  runway  inspections. 

B-1  DOPsfall  into  known  object  categories.  We  check  them  all  the  time. 

In  the  preventable  category. 

OA  has  no  direct  affect  on  dropped  object  rates. 


I  think  the  way  the  question  should  he  ask  is  how  much  does  OA  evaluations  affect  and/or  influence  unit  wing  rates.  OA  does  not  do  a  lot 
of  hands-on  maintenance.  And  maybe  I'm  missing  your  intent,  hut  1*11  answer  assuming  the  question  is  based  on  evaluations  not  hands-on. 


They  can  he  based  on  BPO  Preflight  OVIs  and  follow  up  training  in  high  miss  or  failure  areas,  ie.  oil  access  doors.  Again  only  if  preflights 
weie  KTL  item,  not  feasible  realistic  in  my  opinion. 

OA  can  help  with  awareness  and  proper  maintenance  procedures  to  prevent  dropped  objects  hut  maintenance  practices  material  failure 
play  the  most  significant  role  here! 

Dropped  objects  have  been  a  true  had  subject  because  it  takes  those  extra  steps  to  research  looking  the  for  root  causes. 
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06:  ACC  aircraft  unit  wing  Aircraft  Tire/Foreign  Object  Damage  rates  are  affected  by  the  quality  of  work  performed  by  aircraft 
maintenance  Ouality  Assurance  personnel. 

06  [5|4  |5|E|5|2|5  1 3 13 1 4 1 4 1 5 1 5 1 1 1 5 1 4 1 4 15 1 2 [ 5 1 6 1 4 1 6 1 2 1 5 1 3 14 1 5 [ 3 1 5 1 4 1 4 ] 3 1 2 1  |  4.06  1  61.2%  1  1.28  1  1.63 

0.31 

OA  personnel  at  barksdale  do  not  perform  maintenance  on  acft.  But  through  their  inspection  process  it  does  have  a  positive  impact  on 
AircraftTire  Foreign  Object  Damage. 

Generally  most  aircraft  tire  FOD  rates  are  related  to  the  maintenance  actions  (i.e.,  repair  servicing  Preflight  inspection)  that  were 
previously  performed.  The  maintenance  actions  are  such  that  it  would  not  he  apparent  to  any  qualified  OA  inspector  to  denote  there  was  a 
potential  issue  to  begin  with.  OA  inspectors  DO  NOT  perform  maintenance  and  the  only  way  an  inspector  would  detect  a  problem  was  is 
they  were  evaluating  Pieflight  and  Launch  procedures.  Noimally.  the  last  line  of  defense  on  preventing  a  dropped  object  is  the  person 
that  performed  the  Exceptional  Release  and  or  the  technicians  performing  end  of  runway  inspections. _ 

In  the  preventable  category. _ 

If  we’re  talking  about  an  organization  wheie  the  Wing  FOD  Manager  works  in  OA,  yes. _ 

Rates  are  can  he  affected  by  OA  Assurance  personnel  involvement  and  follow  up  on  the  FOD  program. 

I  think  the  way  the  question  should  he  ask  is  how  much  does  OA  evaluations  affect  and  or  influence  unitwing  rates.  OA  does  not  do  a  lot 
of  hands-on  maintenance.  And  maybe  I'm  missing  your  intent,  hut  I'll  answer  assuming  the  question  is  based  on  evaluations  not  hands-on. 

Again,  rests  mainly  on  maintenance  personnel  hut  OA  and  the  Wing  FOD  Manager  play  a  big  role  in  education  and  enforcement  of  sound 
FOD  prevention  procedures. 
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07:  ACC  aircraft  unit  wing  Engine  Foreign  Object  Damage  rates  aie  affected  by  the  quality  of  woik  performed  by  aircraft  maintenance 
Ouality  Assurance  personnel. 

07  |5|4  [5l6|5|2|  5  14|3|4|5|5|6|1  |4[4|j|5|2|5|6|4|6|2|6|5|4|5|5|5|4|4l3|2|  |  4,26  |  65.3%  |  1.31  I  1.72  I  0.31 

OA  personnel  at  baiksdale  do  not  peifonn  maintenance  on  acft  But  through  their  inspection  process  it  does  have  a  positive  impact  on 
Engine  Foreign  Object  Damage. 

Generally  engine  FOD  rates  are  related  to  ingestion  or  internal  engine  component  failure.  The  way  an  inspector  would  detect  a  problem 
was  if  they  were  evaluating  Preflight  Launch  procedures  and  FO  was  on  the  ramp  in  the  general  area  of  the  aircraft.  For  the  most  part, 
there  is  not  a  way  to  relate  ingestion  and  the  OA  inspectors  quality  of  work.  Also,  there  is  no  way  for  the  OA  inspector  to  know  if  there  was 
need  for  concern  regarding  potential  internal  engine  component  failure.  That  is.  the  OA  inspector  performs  a  Ouality  Verification 
Evaluation  upon  the  engine  completing  a  test  cell  run.  The  inspector  is  reviewing  the  forms  and  evaluating  the  external  condition  of  the 
engine  based  on  the  maintenance  actions.  But  since  the  maintenance  actions  are  so  extensive  it  would  not  he  apparentto  any  qualified 
OA  inspector  to  denote  there  was  a  potential  issue  to  begin  with. 

In  the  preventable  category. 


Not  by  direct  work  performed,  hut  by  follow  up  and  enforcement  of  FOD  policies. 


I  think  the  way  the  question  should  he  ask  is  how  much  does  OA  evaluations  affect  and/or  influence  unit  wing  rates.  OA  does  not  do  a  lot 
of  hands-on  maintenance.  And  maybe  1‘m  missing  your  intent,  hut  I'll  answer  assuming  the  question  is  based  on  evaluations  not  hands-on. 


Again,  rests  mainly  on  maintenance  personnel  hut  OA  and  the  Wing  FOD  Manager  play  a  big  role  in  education  and  enforcement  of  sound 
FOD  prevention  procedures. 
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08:  ACC  aircraft  unit  wing  Aircraft  Class-B  Mishap  rates  are  affected  by  the  quality  of  work  performed  by  aircraft  maintenance  Ouality 
Assurance  personnel. 

08  |4 1  4  [4 [5 15 12 1  5  U 1 3 1 4 1 5 14 1 4 1 1  |4 [4 [5 U |2 1 1  |5 1 4 16 12 15 14 1 4 15 14 U 1 4 14 13 12 1  I  3.82  I  56.5%  I  1.19  I  1.42  I  0.31 

OA  personnel  at  barksdale  do  not  perform  maintenance  on  acft.  But  through  their  follow-up  inspection  process  of  preflights.  etc.  it  does 
have  a  positive  impact  on  Aircraft  Class-B  Mishap. 

Based  on  the  types  of  Class  B  Mishap  rates  heie  at  Nellis  patch.  I  have  not  seen  a  correlation  between  the  event  and  the  quality  of  work 
performed  by  the  OA  personnel. 

I  think  the  way  the  question  should  be  ask  is  how  much  does  OA  evaluations  affect  and/or  influence  unit  wing  rates.  OA  does  not  do  a  lot 
of  hands-on  maintenance.  And  maybe  I'm  missing  your  intent,  but  I'll  answer  assuming  the  question  is  based  on  evaluations  not  hands-on. 

Dependent  on  OA  presence  on  the  flight  light  in  prevention  of  maintenance  induced  ground  mishaps.  Any  ground  mishaps  can  be 
impacted  by  OA  presence  visibility  on  the  flight  line.  Greater  presence  visibility  could  potentially  reduce  improper  ground 
handling/service/maintenance  procedures  that  lead  to  mishaps. 

OA  can  help  prevent  through  awareness,  enforcement,  education  but  sound  maintenance  practices,  aircrew  discipline,  and  aircraft  part 
reliability  are  drivers. 
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09:  ACC  aircraft  unit  wing  Aircraft  Class-C  Mishaps  rates  are  affected  by  the  quality  of 
Assurance  personnel. 

work  performed  by  aircraft  maintenance  Ouality 

09  1 4 1  4  |4|5[5|2|5  1 4 1 3 1 4 1 5 1 4 1 4 1 1 |4|4|5|4|2|1 14|4|6|2|5|5|4|5|4|4|4|5|3|2| 
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OA  personnel  at  barksdale  do  not  perform  maintenance  on  acft.  But  through  their  follow-up  inspection  process  of  preflights,  etc.  it  does 
have  a  positive  impact  on  Aircraft  Class-C  Mishap. 


Based  on  the  types  of  Class  C  Mishap  rates  here  at  Nellis  patch.  I  have  not  seen  a  correlation  between  the  event  and  the  quality  of  work 
performed  by  the  OA  personnel. 


I  think  the  way  the  question  should  be  ask  is  how  much  does  OA  evaluations  affect  and/or  influence  unit  wing  rates.  OA  does  not  do  a  lot 
of  hands-on  maintenance.  And  maybe  I'm  missing  your  intent,  but  I'll  answer  assuming  the  question  is  based  on  evaluations  not  hands-on. 


Any  ground  mishaps  can  be  impacted  by  OA  presence  visibility  on  the  flight  line.  Greater  presence  visibility  could  potentially  reduce 
improper  ground  handling  service  maintenance  procedures  that  lead  to  mishaps. 

OA  can  help  prevent  through  awareness,  enforcement,  education  but  sound  maintenance  practices,  aircrew  discipline,  and  aircraft  part 
reliability  are  drivers. 
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1  1  1  Effect  1  1 

1  Coeff  of 

0# 

Ratings 

Me. in  „  “  Std  Dev  V.n 

1  1  1  1  1 

Vai 

010:  ACC  aircraft  unit  wing  Maintenance  Personnel  Training  pass  rates  are  affected  by  the  quality  of  work  performed  by  aircraft 
maintenance  Ouality  Assurance  personnel. 

OIO  |S|4  |4|6|4|5|  6  |3|5|4|4|e|2|3|2|4|3|5|2|4|5|4|6|5|5|4|4|S|2|l  |6|3|3|4|  I  4.09  I  61.8%  I  1.36  I  1.84  I  0.33 

The  only  OA  interface  with  mx  training  quality  is  annual  PEs  on  instructors,  course  reviews,  and  an  occasional  MSEP  inspection  (T.O.s, 
CTKs,  etc). 

I  would  tend  to  agree  with  this  statement.  Our  OA  inspectors  perform  PE  on  FTD  Instructors... we  also  perform  PE  on  50  percent  of  the 
members  who  complete  the  FTD  course 

Through  the  OA  personal  evaluation  (PE)process  it  creates  a  positive  impact  of  pass  rates.  Increases  individual  awareness  and  attention  to 
detail. _ 

Based  on  the  Maintenance  Personnel  Training  (i.e.,  MTF)pass  rates,  our  purpose  is  to  verify  that  the  technician  instructor  are  performing 
tasks  commensurate  with  their  AFSC  and  skill  level.  However,  when  we  are  performing  Ouality  Verification  Inspections  and  there  is  a 
potential  for  training.  I  would  say  that  we  are  affecting  the  future  pass  rate  in  a  positive  direction  because  the  instructor  will  include  the 
feedback  in  their  work  ethic. _ 

Depends  on  how  much  of  a  training  role  the  OA  takes  on.  This  is  more  influenced  by  the  background  and  personality  of  the  OA  Chief  and 
Iris  her  interaction  with  the  MXG/CC  than  the  quality  of  work  performed  by  OA. 

Indirectly  through  after  training  and  qualification  evaluations. 

They  can  influence  along  with  maintenance  training  flight  but  supervisors  and  trainers  in  the  sections  have  the  most  influence. 

OA  needs  to  be  the  eyes  and  ears  to  see  if  the  training  g  being  accomplished  meet  the  needs.  But  at  the  same  time  OA  in  the  first  line  of 
trainers  and  many  OAs  miss  this  point  leaving  mx  training  in  the  role  alone. 


Ratings 


Mean 


Effect 

Rating 


Std  Dev  Vat 


Coeff  of 
Var 


Oil:  ACC  aircraft  unit  wing  Phase  Dock  Inspection  pass  rates  are  affected  by  the  quality  of  work  performed  by  aircraft  maintenance 
Ouality  Assurance  personnel. 


|6|3  |5|B|6|5|6  1 4 1 5 1 4 1 5 1 6 1 2 1 3 1 5 1 5 1 4 1 4 1 5 1 5 1 6 1 4 1 6 1 5 1 6 1 B 1 5 1 5 1 3 1 5 1 6 1 6 1 3 1 2 1  |  476  |  75.3%  |  1.21  |  1.46 


Oil 


0.25 


Our  OA  personnel  identify  work  card  discrepancies,  we  also  conduct  additional  training  to  correct  negative  trends 


With  the  KTL  inspection  criteria  directed  for  OA  phase  foliow-up  it  helps  highlight  areas  of  special  interest. 


Based  on  the  Phase  Dock  Inspection  pass  rates,  our  purpose  is  to  veiify  that  the  technician  is  performing  tasks  commensurate  with  their 
AFSC  and  skill  level.  However,  when  we  are  performing  Ouality  Verification  Inspections  and  there  is  a  potential  for  training.  I  would  say 
that  we  are  affecting  the  future  pass-rate  in  a  positive  direction  because  the  instructor  will  include  the  feedback  in  their  work  ethic. 


They  can  influence  along  with  maintenance  training  flight  but  supervisors  and  trainers  in  the  sections  have  the  most  influence. 


I  Coeff  of 

H 

Ratings 

Mean  \  n  .  Std  Dev  Vai 

U  1  R-W'XI  1 

v.11 

012:  ACC  aircraft  unit  wing  Repeat  rates  are  affected  by  the  quality  of  work  performed  by  aircraft  maintenance  Ouality  Assurance 
personnel. 

012  |3|3  |5|5|4|2|  3  |3|2|3|4|4|2|5|4|4|1  |4|2|l|4|4|6|2|4|5|4|5|3|4|5|4|3|4ll  3.56  I  51.2%  I  1.21  I  1.47  I  0.34 


OA  realistically  cannot  control  repeats  unless  the  repeats  are  effected  by  a  training  issue. 

Yes.  because  the  OA  Chief  Inspector.  Maintenance  Superintendent,  and  Flight  Commandei  review  the  repeats  based  on  MDS  to  note 
common  threads  and  in  turn  provide  our  observations  with  the  respective  AMU  Chiefs  OICs. 

I  think  the  way  the  question  should  be  ask  is  how  much  does  OA  evaluations  affect  and/or  influence  unit  wing  rates.  OA  does  not  do  a  lot 
of  hands-on  maintenance.  And  maybe  I'm  missing  your  intent,  but  I'll  answer  assuming  the  question  is  based  on  evaluations  not  hands-on. 

Not  directly  but  experience  and  on  the  spot  training  by  OA  personnel  can  help  to  curve  repeat  trends  as  technicians  learn  to  apply 
troubleshooting  techniques  that  you  sometimes  can't  get  from  a  TO. 

Rests  mainly  on  the  quality  of  maintenance  being  performed  and  reliability  of  replacement  parts  but  OA  can  definitely  verify  quality  of 
maintenance  being  performed  on  repeat  write-ups. 

OA  should  the  first  to  ask  the  why  question  when  repeats  are  seen. 
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0?  1  Ratings 

Mean 

fff®Ct  1  St<l  Dev  1  V.ii  1 
Rating  1 

Coeff  of 
Var 

013:  ACC  aircraft  unit  wing  Recur  rates  are  affected  by  the  quality  of  work  performed  by  aircraft  maintenance  Ouality  Assurance 
personnel. 

013  1 3 1  3  1 5 1 5 1 4 1 2 1  3  1 3 1 2 1 3 1 3 1 4 1 2 1 5 1 4 1 4 1 1 |4|2|l 1 4 1 4 16 12 15 1 4 1 4 15 14 14 1 4 14 13 14 1 

1  3.53 

50.6%  |  1.19  |  1.41  | 

0.34 

OA  realistically  cannot  contiol  repeats  unless  the  recur  are  effected  by  a  training  issue. 


Yes.  because  the  OA  Chief  Inspector.  Maintenance  Superintendent,  and  Flight  Commander  review  the  recurs  based  on  MDS  to  note 
common  threads  and  in  turn  provide  our  observations  to  the  respective  AMU  Chiefs  OICs. 

I  think  the  way  the  question  should  he  ask  is  how  much  does  OA  evaluations  affect  and/or  influence  unit  wing  lates.  OA  does  not  do  a  lot 
of  hands-on  maintenance.  And  maybe  I'm  missing  yom  intent,  hut  1*11  answer  assuming  the  question  is  based  on  evaluations  not  hands-on. 

Not  directly  but  experience  and  on  the  spot  training  by  OA  personnel  can  help  to  curve  repeat  trends  as  technicians  learn  to  apply 
troubleshooting  techniques  that  you  sometimes  can't  get  from  a  TO. 

Rests  mainly  on  the  quality  of  maintenance  being  performed  and  reliability  of  replacement  parts  but  OA  can  definitely  verify  quality  of 
maintenance  being  performed  on  repeat  write-ups. 

OA  needs  to  question  for  every  recur  and  look  for  trands. 


°*  I _ Ra<lll9S _ T _ I  I  Heaw  I  j  S«tl  Dev  j  yal  |  L0°lnt 

014:  ACC  aircraft  unit  wing  Late  Takeoff  rates  are  affected  by  the  quality  of  work  performed  by  aircraft  maintenance  Ouality  Assurance 
personnel.  _ _ _ _ _ 

014  |2|3|3|5|4|2|3  |3|2|3|3|4|5|5|2|3|l|4|2|l|l|3|6l2|l|2|2|5|3|2|4|5|2|2|  |  2.94  I  38.8%  I  1.35  I  1.81  I  0.46 

OA  realistically  cannot  control  late  takeoffs  unless  it  is  effected  by  a  training  issue  in  how  to  troubleshoot. 

Yes.  because  the  OA  Chief  Inspector.  Maintenance  Superintendent,  and  Flight  Commander  review  the  Late  Takeoff  rates  based  on  MDS  to 
note  common  threads  and  in  turn  provide  our  observations  to  the  respective  AMU  Chiefs  OICs. 

The  B-1  is  a  different  aircraftfrom  previous  aircraft. 

I  think  the  way  the  question  should  be  ask  is  how  much  does  OA  evaluations  affect  and/or  influence  unit  wing  r*ites.  OA  does  not  do  a  lot 
of  hands-on  maintenance.  And  maybe  I'm  missing  your  intent,  but  I'll  answer  assuming  the  question  is  based  on  evaluations  not  hands-on. 

Rests  solely  on  leadership  on  the  flight  line. 


0«  1  Ratings 

Mean 

Effect 

Rating 

SKI  Dev  Vai 

Coeff  of 
Var 

015:  ACC  aircraft  unit  wing  Safety  tates  are  affected  by  the  quality  of  work  performed  by  aircraft  maintenance  Ouality  Assurance 
personnel. 

015  1 4 1  5  1 5 1 6 1 6 1 3 1  6  |4|4 |4|3|5|4|5|5|4|3|4|5|5|4|5|6|5|6|4|4|5|4|5|6|5|3|4|  1 

4.59 

71 .8% 

1  0.92  |  0.86  | 

0.20 

Through  the  OA  personal  evaluation  (PE)process  it  creates  a  positive  impact  of  pass  rates.  Increases  individual  awareness  and  attention  to 
detail. 


Yes.  because  the  mere  presence  of  OA  inspectors  in  the  flight  line  and  back  shop  work  areas  causes  the  maintenance  technician  to  slow 
down  and  ensure  they  are  doing  the  job  correctly  by  the  TOs.  But  regardless  of  the  amount  of  OA  presence,  there  are  always  the  cases 
where  the  technician  performs  DSVs.  TDVs.  and  UCRs  right  in  front  of  the  OA  inspector. _ 

Not  familiar  with  the  metric  "Safety  Rates” _ 

By  enforcement  of  AFI  and  AFOSH  standards  and  Wing  Instructions  to  ensure  adherence. _ 

They  can  influence  but  rests  on  leadership. _ 

Between  OA  and  flight  line  supervisors  every  safety  incident  should  be  detected. 


I  Coeff  of 

H 

Ratings 

Mean  \  n  .  Std  Dev  Var 

U  1  R'T""I  1 

Vai 

016:  ACC  aircraft  unit  wing  HHO  Inspection  (i.e.  IG.  LOCAT.  ESHOCAMP,  SAVs,  etc.)  pass  rates  are  affected  by  the  quality  of  work 
performed  by  aircraft  maintenance  Ouality  Assurance  personnel. 

016  |4 1  5  |6|B|6|5|  6  |4 1 3 U |5 15 1 6 15 Is >4 15 1 4 15 15 16 1 6 U |5 16 15 1 5 15 15 16 1 6 15 13 16 1  I  5.06  I  81.2%  I  0.89  I  0.78  [  0.18 


OA  is  the  lead  evaluation  arm  in  the  MXG.  therefore  is  has  a  large,  direct  impact  on  inspections  along  with  unit  leadership. 

I  believe  the  OA  Activity  Inspections  program  and  the  fact  that  we  ate  the  primary  for  the  Groups  Compliance  Inspections  will  directly 
affect  the  quality  of  work  this  Wing  Group  produces. 

OA  inspection  process  (activity  management)  ensures  units  are  well  prepared  foi  HHO  inspections 

Yes.  because  the  mere  presence  of  OA  inspectors  in  the  flight  line  and  back  shop  work  areas  causes  the  maintenance  technician  to  slow 
down  and  ensure  they  are  doing  the  job  correctly  by  the  TOs.  Moreover,  through  the  MSEP  and  Activity  Inspection  program.  OA  is  a  the 
forefiont  and  ultimately  through  the  inspection  progress,  the  unit  wing  will  improve  its  pass  rate.  However,  regardless  of  the  amount  of  OA 
presence,  there  are  always  the  cases  where  the  technician  performs  DSVs,  TDVs.  and  UCRs  right  in  front  of  the  OA  inspector. 

OA  provides  in-depth  pre-inspections  in  getting  Wing's  ready  for  an  inspection. _ 

They  can  influence  but  rests  on  leadership. 
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0, 

Fill-In  Ratings 

017/018/019:  ACC  aircraft  unit  winci  rates  are  affected  l>v  the  duality  of  work  performed  l>v  airciaft  maintenance  Ouality 

Assurance  personnel. 

Ratin<| 

Metric 

6 

Key  Task  list 

OA  should  take  on  a  broader  role  evaluating  processes,  not  just  individuals,  equipment,  vehicles  or  facilities.  8 
Hour  fix  rate  is  crucial  since  it  normally  reflects  the  second  maintenance  shift's  (usually  swings)  ability  to  fix 
aircraft,  including  code  3  bleaks.  A  low  8  hi  fix  late  usually  means  trouble  the  next  day's  flying  schedule. 

5 

KTL 

No  comment 

6 

Ouality 

Verification 

Inspections 

FSE  can  identify  maintenance  deviations,  including  mx  lates  and  mx  cancellations.  OA  can  have  an  impact  here 
if  they  pursue  root  causes,  togethei  with  analysis  and  training,  of  these  deviations  and  recommend  corrective 
actions.  Along  with  evaluations  and  management  of  programs,  this  is  should  be  a  critical  pait  of  OA's  business. 

U  nfo  Hun  ate  ly,  it  often  is  not  because  of  lack  of  MXG/CC  focus,  lack  of  inspector  tiaining,  or  lack  of  OA  manning, 
to  include  lack  of  expeiience  rank  in  the  SNCO  &  officer. 

5 

Flying 

Scheduling 

Effectiveness 

No  comment 

4 

mission  capable 

The  more  OA  is  involved  in  flightline  maintenance  ...  the  more  knowledgeable  the  maintenance  troops  are  at 
troubleshooting  discrepancies.  This  is  not  an  immediate  process,  it  will  take  time  if  a  OA  is  not  directly  involved 
in  maintenance. 

4 

MC  rates 

Rest  on  flightline  leadership /airfield  mgtto  enforce  sound  FOD  prevention  piocedures. 

4 

mission  capable 

No  comment 

5 

MC  rates 

No  comment 

5 

8  hour  fix 

No  comment 

4 

8/12  hour  fix 

rate 

No  comment 

6 

12  lu  fix  rates 

No  comment 

5 

Fix  rates. 

No  comment 

5 

Deficiency 
reporting  rate 

1  go  back  to  my  comment  on  the  second  question.  If  OA  re-enforces  what  the  technician  has  alieady  been  taught 
then  all  maintenance  will  be  performed  to  a  higher  standard.  1  also  believe  the  reverse  is  true,  if  OA  does  a  poor 
job  of  enforcing  standards  then  the  rates  mentioned  will  suffer. 

5 

Cruise  Missile 
Availability  Rate 

Training  experience  passed  on  from  OA  can  enhance  knowledge  base  of  flightline  technicians  and  potentially 
leduce  fix  times  in  some  instances 

2 

cut  tires 

No  comment 

6 

ORI 

No  comment 

6 

Donor  aircraft 

Same  as  above.  This  is  a  much  broader  metric  and  manning  level,  training.  T.O.  management  accuracy  usage, 
equipment  levels  performance  and  other  factois  play  an  important  part.  MXG/CCs  should  request  OA 
management  inspections  on  areas  possibly  impacting  high  TNMCM  rates  to  gain  feedback  and  to  train  OA 
inspectors  on  how  to  review  multiple  areas  and  provide  recommendations.  Again,  lack  of  OA  manning  and  ops 
tempo  usually  prevents  this. 

5 

TNMCM 

No  comment 

5 

technical  ordei 
compliance 

No  comment 

5 

technical  ordei 
improvement 
initiatives 

No  comment 
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Appendix  H:  Delphi  Survey,  Part-2  Response  for  AFSC  2A0X1 


Respondant  Number 

Ouartiles 

1 

2 

3 

4 

5 

6 

7 

8 

9 

11 

11 

12 

13 

1st 

Median 

3rd 

1st! 

Man! 

3rd! 

Ml 

1.11 

6.11 

6.00 

6.11 

6.11 

61 

6 

11 

6.11 

6.11 

6.00 

61 

6.01 

61 

61 

610 

6 

0110 

6.0011 

11 

111! 

111! 

Ml 

2.81 

211 

4.11 

3.11 

2.51 

275 

4 

11 

281 

2,11 

2.51 

3.10 

3.01 

775 

1.25 

2,1251 

2 

7750 

111 

23! 

36! 

41! 

Ml 

4.16 

435 

51 

4.00 

4.11 

4.16 

4 

11 

4,11 

4.16 

4.16 

41 

4.01 

5.11 

61 

410 

4 

1579 

4  3021 

61! 

63! 

66! 

Ml 

5.11 

4.35 

51 

61 

4.11 

31 

; 

11 

5,11 

2.11 

51 

41 

5.01 

5.11 

6.10 

4,0675 

5 

01 

5  0011 

62! 

81! 

81! 

M3 

2.53 

111 

3.11 

2.1 

2.75 

2.51 

3 

11 

3.11 

2.53 

2.25 

3.10 

3.01 

2.75 

725 

2.3125 

2 

6362 

3.0111 

26! 

33! 

41! 

2A590 

2.41 

215 

3.11 

3.1 

2.75 

2.51 

3 

11 

4.51 

2.47 

2.25 

3.10 

3.01 

2.11 

725 

2.4737 

2 

6510 

3.0111 

29! 

37! 

41! 

Ml 

2.11 

111 

2.11 

2.1 

2.11 

2.11 

2 

11 

21 

2.11 

2.11 

2.10 

3.01 

2.11 

725 

2.0111 

2 

0110 

2.0751 

21! 

21! 

22! 

2A5X2 

211 

111 

2.11 

2.1 

2.11 

2.11 

2 

11 

2.11 

2.11 

2.10 

2.01 

2.11 

725 

2.0111 

2 

0110 

2.0011 

21! 

21! 

21! 

M3 

411 

381 

5.11 

6.1 

411 

3.11 

; 

11 

5.11 

2.11 

4.11 

2.10 

501 

3.11 

6.10 

3.2110 

4 

0000 

5.0011 

44! 

61! 

81! 

1X0 

215 

III 

3.11 

3.1 

2.75 

2.51 

4 

11 

275 

2.25 

2.25 

2.10 

3.01 

3.11 

2.75 

2.3125 

2 

7510 

3.0011 

26! 

35! 

41! 

Ml 

111 

111 

21 

2.1 

111 

751 

4 

11 

11 

2.15 

791 

2.10 

701 

791 

725 

tL'i 

1 

9100 

211 

12! 

18! 

21! 

M2 

1.70 

111 

21 

2.1 

171 

751 

: 

11 

2,11 

751 

775 

21 

2.01 

2.51 

725 

.5510 

1 

8750 

211 

11! 

18! 

21! 

m 

111 

111 

21 

151 

171 

751 

: 

11 

171 

775 

775 

2.10 

1.01 

2.11 

725 

.51 

1 

71 

79375 

11! 

14! 

19! 

M4 

115 

111 

2.11 

1.61 

765 

751 

2 

11 

765 

751 

775 

2.10 

701 

2.11 

725 

.5111 

1 

6510 

79375 

11! 

13! 

19! 

1X5 

111 

111 

2.11 

155 

171 

751 

2 

11 

171 

1.61 

775 

2.10 

2.01 

2.11 

725 

.5251 

1 

7110 

2.0111 

11! 

14! 

21! 

Ml 

2.45 

2.11 

4.11 

3.11 

2.45 

2.11 

2 

11 

2.45 

2.51 

2.25 

2.10 

2.01 

3.11 

725 

2.0111 

2 

3510 

2.4875 

21! 

27! 

31! 

M3 

111 

111 

2.11 

2.11 

175 

751 

2 

11 

1.61 

751 

751 

2.10 

701 

751 

725 

.5111 

1 

5510 

79375 

11! 

11! 

19! 

2A7X4 

1.45 

111 

2.11 

1.55 

175 

751 

2 

11 

145 

725 

751 

2.10 

701 

21 

725 

.3111 

1 

5110 

1.9375 

6! 

11! 

19! 

2E1X1 

216 

21 

41 

1.51 

216 

21 

2 

11 

3.51 

2.11 

21 

1.10 

701 

21 

725 

,6250 

2 

0000 

2.0556 

13! 

21! 

21! 

2E2X1 

216 

21 

5.11 

151 

216 

21 

2 

11 

3,51 

2,11 

21 

1.00 

2.01 

21 

725 

2,01 

2 

Ji 

2.0556 

21! 

21! 

21! 

211X1 

181 

111 

41 

2.11 

181 

751 

2 

11 

175 

775 

181 

1.00 

701 

725 

725 

.2510 

1 

7510 

1.8011 

5! 

15! 

16! 

21X1 

1.41 

111 

2.11 

155 

741 

751 

2 

11 

151 

751 

751 

1.00 

701 

725 

725 

.2510 

1 

4510 

1.11 

5! 

9! 

11! 

211X1 

1.61 

111 

3.11 

1.61 

166 

751 

2 

11 

151 

751 

766 

2.10 

1.01 

725 

725 

.3125 

1 

5110 

1.6842 

6! 

11! 

14! 

212X1 

1.61 

111 

2.11 

1.55 

761 

751 

2 

11 

151 

751 

775 

2.10 

1.01 

725 

725 

,3125 

1 

5110 

77125 

6! 

11! 

14! 
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Appendix  I:  Delphi  Survey,  Part-2  Response  for  AFSC  2A3X0 


Respondant  Number 

Quartiles 

1 

2 

3 

4 

5 

6 

7 

8 

8 

10 

11 

12 

13 

14 

1st 

Wian 

3rd  1st! 

Median  % 

3rd  % 

Ml 

3.10 

100 

4.00 

3.00 

3 

00 

2.50 

3.00 

2.50 

2 

75 

2.50 

4.00 

3.00 

3 

10 

3.10 

2.5625 

3.0000 

3.0852 

31% 

40! 

42! 

MO 

0.00 

600 

61 

6,00 

6 

00 

6.00 

6.00 

600 

6 

00 

6.10 

6.00 

6.00 

5 

00 

6.00 

6.0000 

6,0000 

6,0000 

m 

110! 

100! 

2A3X1 

3.50 

31 

41 

3,00 

3 

50 

3.50 

31 

3.50 

3 

50 

3.50 

4,00 

3.00 

1 

25 

1.25 

3.0000 

3.51 

3  5000 

40% 

51! 

50! 

Ml 

3.1! 

3.00 

3.50 

3 

25 

2.00 

3.00 

3.50 

: 

1! 

3.50 

4.00 

4.00 

4 

25 

1.25 

3  0000 

3.2500 

3.5000 

40! 

45! 

50! 

Ml 

(03 

5.10 

3.00 

5,00 

4 

75 

4.50 

4.00 

4.00 

4 

00 

4.50 

5.00 

4.25 

5 

50 

1.25 

4.0227 

4.3750 

4.8375 

60! 

58! 

73! 

2A590 

3.50 

5.00 

6,00 

5 

00 

5.00 

4.00 

5.00 

6 

00 

6.00 

5.00 

5.00 

6 

00 

6.00 

5.0000 

5.0000 

6.0000 

80! 

81! 

100! 

2A5X1 

3.31 

4.15 

4.00 

5.00 

3 

75 

400 

5.00 

4.50 

3 

31 

4.50 

5.00 

5.00 

2 

00 

1.25 

3  831! 

4,4750 

5.0000 

58! 

70! 

80! 

Ml 

3.73 

415 

4.00 

3.50 

3 

73 

4.00 

4.00 

; 

73 

4.25 

5.00 

3.00 

4 

00 

125 

3.7273 

4.0000 

4.0000 

55! 

50! 

60! 

Ml 

3.36 

2.00 

4.10 

3.00 

: 

36 

3.00 

3.00 

3.50 

: 

36 

3.00 

4.00 

4.00 

: 

75 

3.36 

3.0100 

3.3636 

3.6375 

40! 

47! 

54! 

1X0 

0.00 

2.50 

6.00 

1.00 

00 

5.00 

5.00 

500 

6 

00 

6.00 

4.00 

41 

5 

00 

1.00 

4.0000 

5.0000 

6.0000 

50! 

30! 

110! 

Ml 

3.27 

325 

3.00 

3.50 

3 

27 

3.50 

4.00 

3.27 

3 

27 

3.27 

4.00 

4.00 

4 

25 

125 

3.2727 

3.2727 

38750 

45! 

45! 

58! 

M2 

2.6! 

3.30 

3.00 

3.00 

: 

01 

3.00 

3.00 

2.68 

2 

68 

3.50 

5.00 

3.00 

: 

75 

125 

2.7514 

3.0000 

3.2250 

35! 

40! 

45! 

2A6X3 

2.S2 

110 

3.00 

250 

2 

52 

3.00 

3.00 

282 

2 

50 

2.50 

4.00 

4.00 

: 

50 

125 

2.5000 

28182 

3.0000 

30! 

36! 

40! 

Ml 

2.35 

1.00 

3.00 

2.50 

2 

35 

3.00 

4.00 

205 

2 

50 

2.85 

2.10 

4.00 

3 

50 

125 

2.5000 

2.8545 

3.0000 

30! 

38! 

40! 

2A6X5 

3.11 

(00 

3.00 

3.50 

3 

14 

3.00 

4.00 

3.14 

2 

75 

3.50 

2.00 

3.15 

3 

75 

125 

28125 

3.1364 

3.4125 

36! 

43! 

48! 

1X0 

3.27 

2.00 

3.00 

4.00 

: 

27 

3.00 

3.00 

3.27 

: 

00 

327 

2.00 

3.00 

4 

25 

125 

3.0000 

3.0000 

3  2727 

41! 

41! 

45! 

M3 

2.73 

100 

3.00 

3.00 

; 

73 

2.50 

3.00 

2.73 

2 

50 

2.73 

2.00 

3.00 

3 

50 

125 

2.5000 

2.7273 

30000 

30! 

35! 

40! 

im 

2.36 

100 

3.00 

2,00 

2 

36 

2.36 

2.00 

3.50 

2 

00 

2.36 

2.00 

2.00 

3 

25 

125 

2.0000 

2.1818 

2.3636 

20! 

24! 

27! 

11X1 

153 

2.00 

3.00 

1.50 

53 

1.50 

2.00 

200 

' 

50 

1.75 

100 

1.00 

I 

88 

125 

1.5000 

1  8847 

1.8737 

10! 

18! 

13! 

m 

1.84 

2.00 

3.00 

1.50 

84 

1.50 

2.00 

200 

' 

50 

1.75 

100 

1.00 

i 

84 

1.25 

1.5000 

1  7861 

1.8606 

10! 

16! 

13! 

21X1 

2.00 

100 

3.00 

2,00 

: 

00 

2.00 

2.00 

2.00 

1 

50 

2.00 

100 

100 

2 

00 

125 

1.3125 

2,0000 

2  0000 

6! 

20! 

20! 

21X1 

2.33 

1.00 

3.00 

2.50 

2 

33 

2.00 

3.00 

2.33 

2 

00 

2.33 

100 

1.00 

2 

00 

125 

1.4375 

21667 

2.3333 

8! 

23! 

27! 

21X1 

3.00 

2.00 

3.00 

3.50 

: 

00 

3.00 

3.00 

300 

2 

75 

3.00 

2,00 

2.00 

: 

00 

125 

2.1875 

3,0000 

30000 

24! 

40! 

40! 

212X1 

2.11 

100 

3.00 

1.50 

2 

14 

2.00 

3.00 

2.14 

2 

00 

2.14 

2,10 

1.00 

2 

00 

1.25 

15250 

2.0000 

21364 

13! 

20! 

23! 

150 


Appendix  J:  Delphi  Survey,  Part-2  Response  for  AFSC  2A3X1 


Respondant  Number 

Quartiles 

1 

2 

3 

4 

5 

6 

1 

8 

9 

11 

11 

12 

13 

14 

1st 

Median 

3rd 

lit! 

Median  % 

m 

Ml 

SI 

1.1 

5.1 

61 

El 

5.1 

4.1 

51 

4.1 

41 

5.1! 

5.1 

6.1 

4.001 

511 

5.0000 

60% 

80% 

80% 

n 

3.5? 

1.1 

4.1! 

51 

3.J5 

3.1 

4.1 

31 

3.51 

3.57 

31 

5.11 

2.75 

1.25 

3.0000 

3535? 

3.9375 

40% 

51% 

59% 

Mi 

SI 

61 

6.00 

El 

El 

6.1 

6.1 

61 

6.1 

6.1 

61 

6.1! 

6.1 

6.1 

6,011 

6.010 

6.0000 

100% 

11% 

11% 

M 

SI 

351 

5.1 

El 

5.1 

4.1 

5.1 

61 

5.1 

5.1 

5.1 

6.1! 

6.1 

6.1 

5.0000 

5.001 

610 

80% 

80% 

100% 

2A3X3 

2.81 

111 

4.1 

31 

281 

2.51 

4.1 

31 

2.51 

3.25 

41 

4.1 

3.51 

1.25 

2.5774 

311 

38750 

32% 

41% 

58% 

2A590 

3.2S 

111 

4.1 

41 

3.25 

3.1 

4.1 

351 

3.25 

3.51 

31 

4.11 

3.1 

3.25 

3.0625 

3.251 

38750 

41% 

45% 

58% 

2A5X1 

2.81 

1.11 

4.1 

25! 

25! 

2.5! 

3.1 

2.15 

2.75 

3.25 

21 

4.11 

3.1 

1.25 

2.511 

2.751 

3100 

30% 

35% 

40% 

m 

2.11 

111 

4.1 

21 

2.5! 

25! 

2,1 

251 

3.1 

2.11 

2.1! 

3.1 

1.25 

2,011 

2.510 

27143 

20% 

30% 

1 

w 

(IS 

251 

5.1 

51 

4.15 

3.5! 

3.1 

4.25 

4.05 

4.25 

2.1 

4.25 

4.75 

4.15 

3.6364 

4.0455 

42500 

53% 

61% 

65% 

Ml 

3.52 

2.11 

4.1 

41 

3.25 

352 

4.1 

4.75 

3.25 

3.52 

31 

4! 

3.52 

3.52 

3.3185 

3.5238 

4.0001 

46% 

50% 

60% 

Ml 

2.3S 

111 

4.1 

25! 

2.31 

2.1 

2.1 

21 

2.25 

2.75 

3.1 

2.11 

2.75 

1.25 

2.0000 

2.3155 

2.6875 

20% 

26% 

34% 

Mil 

186 

11 

4.1 

2.11 

186 

1.51 

2.1 

186 

1.75 

2.1 

2.1 

3.11 

2.51 

1.25 

1.7784 

19318 

2.0000 

16% 

19% 

20% 

M3 

2.1 

111 

4.1 

2.11 

21 

2.1 

2,1 

2.09 

21 

2.19 

2.1 

2.11 

2.1 

1.25 

2,011 

2.001 

2.0909 

20% 

20% 

22% 

M4 

2.14 

1.11 

4.1 

2.11 

2.14 

2.1 

2.1 

2.14 

2.1 

2.25 

2.1 

2.25 

2.1 

1.25 

2.0000 

2.001 

2.1364 

20% 

20% 

23% 

Ml 

2.23 

111 

4.1 

21 

2.23 

2.1 

3.1 

2.23 

21 

2.23 

21 

3.01 

2.75 

1.25 

2.0000 

2.2273 

2.6193 

20% 

25% 

32% 

Ml 

in 

2.11 

5.1 

351 

2.11 

2.1 

3.1 

3.00 

2.51 

3.51 

2.1 

3.01 

3.1 

1.25 

2.1250 

2.8864 

310 

23% 

38% 

40% 

Ml) 

1.55 

111 

4.1 

151 

1.35 

1.51 

2.1 

1.95 

2.1 

1.95 

21 

2! 

1.95 

1.25 

1.6136 

1.9545 

210 

12% 

19% 

20% 

2A7X4 

182 

111 

4.1 

151 

182 

1.51 

3.1 

182 

1.75 

1.82 

21 

1! 

1.82 

1.25 

1511 

1.8182 

18182 

10% 

16% 

16% 

2E1X1 

1.3S 

2.11 

5.1 

2.11 

1.35 

2.1 

2.1 

1.95 

2.1 

1.95 

111 

2.1 

1.95 

1.25 

1.9500 

1  9750 

2.0000 

19% 

20% 

20% 

2E2X1 

2.IS 

2.1! 

5.1 

151 

2.15 

2.1 

2.1 

2,15 

211 

2.15 

111 

2! 

2.15 

1.25 

2,011 

2  001 

2  0526 

20% 

20% 

21% 

1X1 

181 

1.1! 

4.1 

151 

181 

1.51 

2.1 

181 

1.75 

1.81 

111 

2.01 

1.25 

1.25 

1.3125 

1.7798 

1.8095 

6% 

16% 

16% 

21X1 

1.64 

1.1! 

4.1 

151 

1.64 

1.51 

2.1 

1.64 

1.75 

1.75 

111 

1.01 

1.25 

1.25 

1.251 

15682 

1.7216 

5% 

11% 

14% 

211X1 

1.3S 

Ill 

4.1 

2.11 

1.35 

1.51 

2,1 

1,95 

21 

1.95 

21 

1.01 

1.25 

1.25 

1.3125 

1.9545 

2.0000 

6% 

19% 

20% 

212X1 

1.68 

11 

4.1 

151 

166 

1.51 

2.1 

1.68 

1.61 

1.68 

2.1 

1.01 

1.25 

1.25 

1.3125 

1  6409 

1.6818 

6% 

13% 

14% 

151 


Appendix  K:  Delphi  Survey,  Part-2  Response  for  AFSC  2A3X2 


Replant  Number 

Ouartiles 

1 

2 

3 

4 

5 

6 

I 

8 

3 

11 

11 

12 

13 

1st 

Median 

3rd 

M 

Median  % 

3(i% 

Ml 

61 

1.1 

5.1 

6.11 

6.1 

5.1 

4 

00 

5,1 

4.00 

4.00 

5.0! 

5.00 

6 

00 

4.0000 

5.0000 

5.0000 

60% 

80% 

80% 

Ml 

3.31 

1.1 

4! 

51 

4.1 

3.51 

4 

II 

3.1 

325 

375 

3.00 

5.0! 

275 

1 

25 

3.1250 

3  7500 

4100 

43% 

65% 

60% 

Ml 

61 

1.1 

5.1 

6.1 

5.1 

5.1 

5 

II 

61 

5.00 

5.00 

4.00 

6.00 

6.00 

6 

00 

5,0000 

5.0000 

6100 

80% 

80% 

100% 

2A3X2 

61 

6.1 

6.1 

6.1 

6.1 

6.1 

6 

II 

61 

6,00 

6.00 

6.00 

6.00 

6.00 

6 

00 

6,0000 

6.0000 

6.0000 

100% 

100% 

100% 

M3 

21 

1.1 

3.1 

3.1 

3.1 

2.51 

3 

00 

31 

225 

3.50 

4.00 

4.00 

3.50 

1 

25 

27625 

3.0000 

3  3750 

35% 

40% 

48% 

2A590 

2.61 

2.1 

4.1 

4.1 

2.84 

2.51 

3 

00 

351 

2.75 

3.50 

3.00 

4.00 

3.00 

: 

84 

2,8421 

3100 

3.100 

37% 

40% 

50% 

Ml 

2.56 

1.1 

3.1 

251 

251 

2.51 

2 

II 

215 

275 

3.25 

31 

400 

275 

i 

25 

2  501 

2.6645 

2.3375 

30% 

33% 

33% 

2A5X2 

255 

1.1 

3.1 

2.1 

251 

2.51 

: 

00 

2.50 

3.00 

3.00 

2.00 

3.00 

1 

25 

2.0000 

2.5000 

3.0000 

20% 

30% 

40% 

Ml 

1.26 

3.1 

3.1 

5.1 

428 

3.51 

4 

00 

4.25 

375 

4.50 

5.00 

1.00 

475 

4 

28 

3.5625 

4.2633 

4.4444 

51% 

65% 

63% 

Ml 

3.11 

2.1 

4.1 

4.1 

31 

3.1 

: 

00 

3.1 

3.00 

3.25 

3.00 

3.0! 

3.10 

3 

10 

3.0000 

3.1000 

3.2125 

40% 

42% 

44% 

Ml 

2.21 

11 

3.1 

2.1 

221 

2.1 

; 

00 

2.0! 

2.1 

2.50 

3.00 

2.00 

275 

1 

25 

2.0000 

2.110 

2510 

20% 

22% 

30% 

M2 

1.85 

1.1 

3.1 

2.1 

1.85 

1.51 

2 

00 

1.85 

175 

2.25 

2.00 

3.00 

2.50 

1 

25 

.7750 

1.8250 

2.1875 

16% 

13% 

24% 

M3 

21 

1.1 

3.1 

2.1 

2.1 

2.1 

2 

00 

21 

2.00 

2.00 

2.00 

2.25 

2.00 

1 

25 

2.0000 

2.100 

2.0000 

20% 

20% 

20% 

Ml 

2.15 

1.1 

31 

2.1 

2.15 

2.1 

2 

01 

2.05 

2.25 

2.25 

2.00 

250 

2.00 

1 

25 

2.0000 

2.0250 

2.2000 

20% 

21% 

24% 

2/161(5 

2.11 

11 

3.1 

2.1 

2.11 

2.1 

2 

00 

2.11 

2.45 

2.50 

2.00 

3.00 

275 

1 

25 

2.0000 

2.1053 

2.4875 

20% 

22% 

30% 

MS 

255 

2.1 

4.1 

3.1 

2.55 

2.51 

2 

00 

3.0! 

2.50 

3.50 

2.00 

275 

3.1 

1 

25 

2.5000 

2.5500 

3.0000 

30% 

33% 

40% 

Ml 

1.85 

1.1 

3.1 

1.1 

1.85 

1.51 

2 

00 

1.85 

175 

1.55 

2.00 

2.00 

185 

1 

25 

.5625 

1.8500 

1.3625 

11% 

17% 

13% 

Ml 

181 

1.1 

3.1 

1.1 

1.81 

1.51 

2 

00 

1.80 

175 

1.60 

2.00 

1.00 

1.80 

1 

25 

.5000 

1.8000 

1.801 

10% 

16% 

16% 

2E1X1 

1.83 

2.1 

4.1 

2.1 

1.83 

2.1 

2 

00 

3.00 

2.1 

1.83 

1.00 

2.00 

1.83 

1 

25 

.8347 

2.100 

2.0000 

18% 

20% 

20% 

2E2X1 

1.83 

2.1 

4.1 

1.1 

1.33 

2.1 

2 

II 

2.01 

176 

1.83 

1.00 

2.00 

1.83 

1 

26 

7862 

1  8547 

2100 

16% 

15% 

20% 

2111 

11 

1.1 

3.1 

1.1 

161 

1.51 

2 

II 

1,60 

150 

175 

1.00 

2.00 

1.25 

1 

26 

,3125 

1.5500 

1.7125 

6% 

11% 

14% 

21X1 

155 

1.1 

31 

1.1 

1.55 

1.51 

2 

00 

155 

1.50 

175 

1.00 

11 

1.25 

1 

25 

.2500 

1.5000 

1  5500 

5% 

10% 

11% 

211X1 

1.35 

1.1 

3.1 

2.1 

1.35 

2.1 

2 

II 

1,35 

2,00 

1.35 

2.00 

1.00 

1.25 

1 

25 

.4250 

1  3500 

2.0000 

3% 

15% 

20% 

212X1 

1.21 

1.1 

3.1 

1.1 

121 

1.51 

2 

II 

1,20 

175 

175 

2.00 

1.00 

1.25 

1 

25 

.3125 

17000 

1  7500 

6% 

14% 

15% 

152 


Appendix  L:  Delphi  Survey,  Part-2  Response  for  AFSC  2A3X3 


Respondant  Number 

Ouartiles 

1 

2 

3 

4 

5 

6 

7 

8 

3 

11 

11 

12 

13 

Is! 

Median 

3rd 

M 

Median  % 

Ml 

Ml 

2.42 

111 

31 

2.11 

2.51 

21 

2 

11 

251 

2 

26 

2.42 

3.11 

3.11 

2.42 

1.25 

2,11 

2.4211 

251 

21% 

28% 

31% 

Ml 

6.11 

111 

51 

5.11 

5.11 

4.51 

6 

11 

551 

5 

11 

5.25 

3.11 

6.11 

4.75 

1.25 

4.5626 

61111 

52138 

71% 

81% 

84% 

2A3X1 

3.26 

111 

31 

3.11 

3.11 

31 

3 

II 

351 

3 

11 

3.26 

3.11 

3.11 

3.51 

1.25 

3,11 

3.11 

31374 

41% 

41% 

44% 

2A3X2 

3.53 

111 

31 

3.11 

3.11 

21 

: 

II 

4,11 

3 

51 

3.53 

4.11 

4.11 

411 

1.25 

3,1111 

3.2511 

3.8816 

41% 

45% 

58% 

M3 

6.11 

6.00 

6.11 

6.11 

6.11 

61 

6 

II 

6,11 

3 

11 

6.01 

6.11 

6.11 

6.11 

6.11 

5.0000 

6.2001 

6.11 

111% 

111% 

111% 

2A590 

453 

411 

51 

5.11 

4.75 

4.53 

4 

II 

5,11 

4 

51 

4.75 

3.11 

5.11 

4.25 

4.53 

4.3125 

4.5263 

48375 

66% 

71% 

73% 

2A5X1 

6.11 

ill 

51 

111 

4.11 

ill 

5 

11 

5.11 

4 

II 

6.00 

5.11 

5.11 

ill 

111 

511 

5.2000 

61% 

81% 

81% 

Ml 

5.11 

3.11 

5.11 

111 

ill 

41 

4 

11 

4 

11 

6.01 

3.11 

6.11 

ill 

3.1010 

41111 

5.0000 

41% 

61% 

81% 

M3 

3.55 

111 

4.11 

3.11 

3.15 

3.15 

3 

11 

: 

51 

3 

11 

3.25 

3.11 

4.11 

3.11 

3.15 

3.1111 

3.1511 

321 

41% 

41% 

44% 

Mi 

4.15 

2.11 

4.11 

4.11 

351 

4.15 

4 

11 

i 

11 

3 

75 

4.51 

3.11 

4.11 

3.75 

4.15 

3.7500 

41111 

411 

55% 

61% 

63% 

1M\ 

3.45 

2.11 

4.11 

4.11 

3.45 

3.11 

: 

11 

3 

51 

3 

25 

3.45 

3.11 

4.11 

4.25 

1.25 

3.1111 

3.4511 

3  8751 

41% 

43% 

58% 

2ASX2 

2.21 

2.11 

2.11 

3.11 

2.21 

2.51 

i 

11 

3 

51 

2 

25 

2.51 

4.11 

3.11 

3.11 

1.25 

2.1511 

2.3751 

2.8751 

21% 

28% 

38% 

2ASX3 

2.21 

11 

3.11 

175 

2.21 

2.11 

: 

11 

3 

11 

2 

25 

2.21 

2.11 

2.51 

3.11 

1.25 

2.1111 

2.2111 

2.4375 

21% 

24% 

23% 

2A6X4 

251 

1.11 

3.11 

3.11 

251 

2.51 

: 

11 

3 

11 

2 

75 

2.51 

2.11 

2.75 

ill 

1.25 

2.1251 

2.5111 

28375 

23% 

31% 

33% 

2/16X5 

3.21 

21 

4.11 

4.11 

3.21 

3.11 

3 

11 

4 

11 

3 

11 

3.51 

2.11 

3.25 

411 

1.26 

3.1111 

3.21 

3.8751 

41% 

44% 

58% 

2A6X6 

2.35 

111 

4.11 

355 

2.35 

3.11 

3 

11 

3 

35 

2 

75 

3.25 

2.11 

3.11 

3.51 

1.26 

2.8111 

2.8751 

3.1875 

36% 

41% 

44% 

2A7X3 

251 

111 

4.11 

251 

251 

2.51 

2 

11 

3 

11 

2 

25 

2.75 

2.11 

3.11 

2.75 

1.25 

2.1625 

2.5111 

2  7511 

21% 

31% 

35% 

Ml 

131 

111 

3.11 

1.75 

131 

2.11 

2 

11 

2 

11 

2 

11 

131 

2.11 

2.11 

2.51 

1.25 

.11 

2.1111 

2.0000 

18% 

21% 

21% 

2E1X1 

1.47 

111 

3.11 

155 

1.75 

1.51 

1 

11 

1 

51 

* 

51 

1.51 

1.11 

ill 

1.47 

1.25 

.1625 

14868 

1.11 

1% 

11% 

11% 

2E2X1 

1.47 

111 

31 

151 

1.75 

1.51 

1 

11 

' 

47 

' 

41 

1.51 

1.11 

III 

1.47 

1.25 

.1625 

1.4737 

1.5000 

1% 

8% 

11% 

21X1 

151 

111 

31 

2.11 

161 

1.51 

2 

11 

1 

61 

• 

51 

1.75 

1.11 

ill 

1.25 

1.25 

.2611 

1.5511 

1.7125 

5% 

11% 

14% 

21X1 

151 

111 

31 

1.75 

151 

1.51 

2 

II 

61 

1 

75 

1.75 

111 

ill 

1.25 

1.25 

.2511 

16111 

17511 

5% 

12% 

15% 

211X1 

2.31 

21 

3.11 

2.11 

2.51 

21 

3 

11 

3 

31 

2 

25 

2.25 

3.11 

2.11 

1.51 

1.25 

2,11 

2.2511 

24511 

21% 

25% 

23% 

212X1 

155 

111 

31 

151 

155 

1.51 

2 

II 

1 

65 

1 

61 

1.51 

21 

ill 

1.25 

1.25 

.3125 

1.5511 

46511 

6% 

11% 

13% 

153 


Appendix  M:  Delphi  Survey,  Part-2  Response  for  AFSC  2A590 


Respondant  Number 

Quartiles 

1 

2 

3 

4 

5 

6 

7 

8 

0 

10 

11 

12 

13 

14 

1st 

Median 

3rd 

1st! 

Median  % 

m 

Ml 

2.35 

100 

4.00 

333 

330 

2.50 

3.00 

330 

2.75 

2.50 

4 

00 

3.01 

2 

35 

2.35 

2  7533 

2 

3737 

33000 

36% 

33% 

40% 

MO 

530 

1.00 

5.00 

633 

530 

5.00 

6.00 

530 

630 

6.00 

5 

00 

5.00 

5 

00 

61 

5  0000 

5 

0000 

6.0000 

80% 

80% 

100% 

Ml 

3.22 

100 

4.00 

3.53 

330 

3.00 

3.00 

3.50 

3.25 

3.50 

4 

00 

3.00 

4 

25 

1.25 

3  0000 

3 

2361 

3  5000 

40% 

45% 

50% 

Ml 

3.22 

100 

4.00 

3.50 

3.22 

3.00 

3.00 

3.50 

3.22 

3.50 

4 

00 

4.00 

4 

00 

1.25 

3.0556 

3 

3611 

38750 

411 

47% 

58% 

M3 

335 

100 

5.00 

530 

430 

400 

4.00 

4.50 

3.75 

4.50 

; 

00 

5.00 

4 

50 

1.25 

3.3605 

4 

2500 

4  8750 

53% 

65% 

78% 

2A590 

530 

6.00 

6.00 

6.00 

630 

6.00 

6.00 

630 

630 

51 

6 

00 

6.00 

6 

00 

6.00 

63100 

6 

0000 

53000 

100!. 

100% 

100% 

215X1 

4.24 

4.00 

5.00 

5.03 

4.24 

4.50 

4.00 

5.25 

430 

4.50 

5 

00 

4.50 

5 

50 

1.25 

4  3535 

4 

5000 

5.0000 

61% 

71% 

80% 

M2 

3.55 

3.00 

41 

3.03 

425 

3.50 

41 

350 

4.25 

5 

00 

3.01 

4 

50 

1.25 

33100 

3 

6500 

4.2500 

40!. 

53% 

65% 

Ml 

3.14 

2.00 

3.00 

3.50 

3.14 

3.00 

3.00 

3.50 

3.25 

3.50 

2 

00 

4.00 

4 

00 

3.14 

33000 

3 

1423 

3.5000 

41!. 

43% 

50% 

MO 

530 

2.50 

4.00 

133 

530 

61 

5.00 

630 

631 

6.00 

4 

00 

4.00 

6 

00 

11 

4  3000 

5 

0000 

6.0000 

60!. 

80% 

100% 

Ml 

3.43 

2.50 

3.00 

3.51 

3.43 

3.50 

3.00 

3.43 

3.25 

3.50 

: 

00 

4.01 

4 

25 

1.25 

33100 

3 

4286 

3.5000 

40!. 

43% 

50% 

2A6X2 

2.48 

2.00 

21 

3.00 

330 

2.48 

3.00 

3.50 

2.71 

3.25 

5 

00 

3.00 

3 

75 

1.25 

2.4762 

3 

0000 

3.1875 

30!. 

41% 

44% 

M3 

2.43 

100 

31 

2.51 

2.43 

2.50 

2.00 

2.50 

2.25 

2.25 

2 

00 

3.01 

3 

25 

1.25 

2.0625 

2 

4286 

2  5000 

21!. 

23% 

30% 

2A6X4 

215 

100 

3.00 

3.00 

2.76 

2.50 

3.00 

2.76 

2.50 

2.76 

2 

00 

4.00 

3 

50 

1.25 

2.5000 

2 

7613 

35000 

30!. 

35% 

40% 

2A6X5 

335 

2.00 

41 

3,00 

335 

3.00 

3.00 

4.50 

330 

4.25 

2 

00 

430 

3 

75 

1.25 

33000 

3 

0238 

3  3375 

41!. 

40% 

53% 

2A6X6 

330 

1.00 

41 

3.50 

330 

3.00 

3.00 

3.50 

3.25 

3.25 

2 

00 

3.00 

3 

75 

125 

33000 

3 

0000 

3.4375 

40% 

40% 

43% 

2A7X3 

25/ 

1.00 

4.00 

253 

257 

21 

31 

3.00 

2.25 

2.75 

2 

00 

4.00 

3 

50 

1.25 

2  3625 

2 

6667 

3.0000 

21% 

33% 

40% 

2A7X4 

2.20 

100 

21 

1.75 

2.75 

2.00 

2.00 

2.50 

225 

2.23 

2 

00 

2.01 

3 

00 

1.25 

2.0000 

2 

0000 

2.2857 

20% 

20% 

26% 

2E1X1 

1.53 

100 

21 

230 

1.75 

150 

2.00 

230 

150 

1.50 

1 

00 

1.00 

2 

00 

1.25 

1.3125 

1 

5132 

2  3000 

6% 

10% 

20% 

2E2X1 

1.53 

100 

2.00 

1.50 

1.75 

150 

21 

230 

150 

150 

1 

00 

130 

2 

00 

1.25 

1.3125 

1 

5000 

13375 

6% 

10% 

13% 

21X1 

110 

100 

2.00 

1.50 

170 

1.50 

2.00 

230 

160 

175 

1 

00 

1.00 

2 

00 

1.25 

1.3125 

1 

6500 

13375 

6% 

13% 

13% 

21X1 

1/6 

100 

3.00 

2.25 

1.76 

150 

21 

1.76 

150 

1.75 

1 

00 

1.00 

2 

00 

1.25 

1.3125 

1 

7560 

1.3405 

6% 

15% 

13% 

211X1 

2.14 

2.00 

3.00 

230 

2.75 

2.00 

2.00 

2.14 

2.10 

2.25 

2 

00 

2.00 

2 

14 

1.25 

2.0000 

2 

0500 

2.1423 

20% 

21% 

23% 

2W2X1 

1.81 

100 

3.00 

1.53 

2.25 

1.50 

2.00 

181 

1.75 

2.00 

2 

00 

130 

; 

00 

1.25 

1.5000 

1 

8035 

2  3000 

10% 

16% 

20% 

154 


Appendix  N:  Delphi  Survey,  Part-2  Response  for  AFSC  2A5X1 


Respondant  Number 

Quartiles 

1 

2 

3 

4 

5 

6 

7 

8 

3 

1! 

11 

12 

13 

Is! 

Median 

3rd 

1st  *4 

Median  % 

3rd% 

Ml 

2.41 

16! 

36! 

1.75 

2.41 

26! 

266 

2.41 

2.1! 

2.25 

360 

3.0! 

2.41 

1.25 

2.0000 

2.3305 

2411! 

20% 

27% 

28% 

2A3X0 

(47 

16! 

56! 

4.75 

48! 

46! 

466 

4.5! 

4.25 

4.75 

360 

5.0! 

36! 

1.25 

3.2500 

4.1250 

4.6875 

45% 

63% 

74% 

Ml 

2.81 

16! 

36! 

366 

281 

2.5! 

366 

36! 

2,75 

36! 

360 

3.0! 

36! 

1.25 

2  7656 

3.0000 

3  000! 

35% 

40% 

40% 

2A3X2 

2.34 

16! 

36! 

366 

2.34 

2.5! 

366 

3.5! 

2.75 

36! 

460 

4.0! 

284 

1.25 

2.7578 

2.5706 

3.00!! 

36% 

33% 

40% 

M3 

SI 

1.00 

56! 

6.66 

3.5! 

46! 

566 

66! 

4.00 

66! 

560 

5.0! 

4.00 

660 

I.Oi 

56010 

5  75!! 

60% 

80% 

35% 

2A590 

16! 

66! 

1.66 

5.5! 

11 

566 

6.0! 

18! 

66! 

3.00 

6.6! 

56! 

160 

.0000 

5.0000 

66000 

1% 

80% 

1% 

2A5X1 

6.00 

66! 

6.0! 

5.66 

58! 

6.00 

666 

6.0! 

66! 

66! 

660 

6.0! 

66! 

6.00 

510 

66000 

66000 

100% 

1!!% 

1!!% 

2A5X2 

3.34 

26! 

46! 

3.66 

3.34 

46! 

466 

3.34 

4.25 

460 

3.0! 

56! 

1.25 

3,0000 

3.3412 

4  000! 

40% 

53% 

61% 

M3 

3.11 

16! 

36! 

3.56 

3.11 

2.5! 

366 

3.6! 

3.25 

3.5! 

360 

4.0! 

3.5! 

1.25 

3.0000 

3.0556 

3.4375 

40% 

41% 

43% 

2A6X0 

4.11 

200 

46! 

4.75 

3.75 

3.5! 

466 

4,5! 

3.75 

4.25 

360 

4.0! 

3.25 

1.25 

3.3125 

3  8750 

4.0833 

46% 

58% 

62% 

Ml 

3.2! 

26! 

36! 

3.56 

3.28 

36! 

366 

3.5! 

3.25 

3.5! 

360 

4.0! 

400 

1.25 

3.0000 

3.2633 

3.501! 

40% 

45% 

50% 

2A6X2 

285 

16! 

26! 

3.25 

265 

26! 

266 

3.0! 

26! 

2.25 

460 

3.0! 

3.5! 

1.25 

2.0000 

2  6556 

36000 

20% 

21% 

40% 

M3 

2.17 

16! 

26! 

2.56 

2.17 

26! 

266 

2.25 

2.1! 

2.17 

260 

3.0! 

36! 

1.25 

2600! 

2.1333 

22232 

20% 

23% 

25% 

2A6X4 

267 

16! 

26! 

3.66 

2.57 

26! 

366 

3.6! 

2.5! 

2.67 

260 

4.0! 

3.5! 

1.25 

26000 

2.6667 

36000 

20% 

33% 

40% 

2A6X5 

3.11 

2.00 

36! 

3.55 

3.11 

36! 

366 

3,5! 

3.11 

3.5! 

260 

4.0! 

400 

1.25 

3.0000 

3.1111 

3.5000 

40% 

42% 

50% 

2A6X6 

2.34 

16! 

36! 

3.66 

2.34 

36! 

366 

3.5! 

2.5! 

3.25 

260 

3.0! 

3.5! 

1.25 

2.6111 

3.0000 

3  6000 

32% 

41% 

40% 

2A7X3 

2.51 

16! 

36! 

2.55 

2.75 

2.5! 

266 

3.0! 

2.25 

2.75 

360 

3.0! 

2.5! 

1.25 

2.3125 

2.5000 

2.3375 

26% 

30% 

33% 

Ml 

183 

16! 

26! 

1.56 

183 

21 

266 

3.0! 

1.75 

1.83 

260 

2.0! 

36! 

1.25 

.7708 

1.3167 

2.0000 

15% 

18% 

20% 

m 

1.44 

16! 

26! 

1.56 

1.44 

1.25 

166 

1.5! 

1.5! 

1.5! 

100 

10! 

1.75 

1.25 

.0625 

1.4375 

1.1! 

1% 

3% 

10% 

2E2X1 

1.44 

16! 

26! 

1.56 

1.44 

1.25 

166 

1.44 

1.4! 

1.5! 

100 

1.0! 

1.75 

1.25 

.0625 

14188 

1.4844 

1% 

8% 

10% 

21X1 

1.47 

16! 

26! 

1.56 

1.75 

1.25 

166 

1.47 

1.5! 

1.5! 

160 

1.0! 

1.25 

1.25 

.0625 

1.3603 

1.500! 

1% 

7% 

10% 

21X1 

161 

1.00 

26! 

1.56 

1.51 

1.5! 

266 

161 

1.5! 

1.5! 

160 

1.0! 

1.25 

1.25 

.2500 

1.5000 

1.6111 

5% 

10% 

12% 

211X1 

26! 

26! 

26! 

1.56 

2.8! 

21 

266 

2,0! 

26! 

26! 

360 

2.0! 

1.25 

1.25 

210 

2.0000 

2.000! 

20% 

21% 

20% 

212X1 

1.5! 

16! 

26! 

1.56 

175 

1.5! 

266 

1.5! 

1.5! 

1.5! 

260 

101 

1.25 

1.25 

.3125 

110 

1.6875 

6% 

10% 

14% 

155 


Appendix  O:  Delphi  Survey,  Part-2  Response  for  AFSC  2A5X2 


Respondant  Number 

Quartiles 

1 

2 

3 

4 

5 

6 

J 

8 

8 

11 

11 

12 

13 

14 

Is! 

Median 

3rd 

M 

Median  % 

3rd% 

Ml 

2.11 

ill 

21 

1.15 

2.25 

21 

2 

II 

3.11 

2.11 

211 

31 

3.01 

211 

1 

25 

210 

2.0556 

22153 

20% 

21% 

24% 

Ml 

11 

1.1! 

51 

4.15 

4.16 

41 

4 

II 

4.11 

4.00 

4.25 

3.10 

4.00 

3.00 

1 

25 

3.2510 

40100 

4.0556 

45% 

60% 

61% 

Ml 

2.51 

1.11 

31 

3.11 

2.51 

2.51 

: 

II 

4.11 

251 

2.75 

31 

2.00 

2.50 

1 

25 

2,1250 

2.5000 

2.3375 

23% 

30% 

33% 

M2 

251 

11! 

31 

3.11 

2/5 

2.51 

2 

II 

4.11 

251 

2.75 

41 

3.01 

2.50 

1 

25 

2.5000 

2.6250 

3.0001 

30% 

33% 

40% 

M3 

1.1 

1.1! 

41 

4.11 

351 

41 

4 

II 

4.06 

4.25 

5.10 

5.01 

4.06 

6 

10 

4.0000 

4  0556 

42500 

60% 

61% 

65% 

2A590 

4.41 

Ill 

51 

4.11 

4.41 

41 

I 

II 

4.25 

4.75 

31 

4.00 

4.41 

1 

25 

4.0010 

40100 

44118 

60% 

60% 

68% 

2A5X1 

422 

111 

41 

4.11 

4.22 

411 

J 

II 

4.22 

451 

5.10 

400 

51 

1 

25 

4.0100 

4  0010 

4  2222 

60% 

60% 

64% 

M2 

SI 

61 

61 

6.11 

6.60 

6.00 

6 

II 

6.11 

61 

61 

61 

6.01 

6.00 

6 

10 

6.0000 

6.0001 

6.0000 

100% 

100% 

100% 

M3 

2.34 

111 

31 

3.11 

2.84 

31 

: 

II 

2/5 

31 

31 

3.01 

3.25 

25 

2.8421 

3.0110 

3.0000 

37% 

41% 

40% 

Ml 

331 

21 

41 

4.11 

3/5 

3.51 

j 

II 

3.75 

4.25 

31 

4.00 

3.25 

1 

25 

3.2500 

3.7511 

4.0000 

45% 

55% 

60% 

Ml 

3.16 

211 

31 

4.11 

3.25 

31 

: 

II 

3.16 

3.50 

31 

4.00 

3.50 

1 

25 

30000 

3.1578 

3.5000 

40% 

43% 

50% 

M2 

2.11 

1.1! 

21 

351 

2.11 

21 

i 

II 

21 

2.25 

51 

3.00 

3.50 

1 

25 

2.0010 

2.1111 

3.0000 

20% 

22% 

40% 

M3 

1.84 

1.1! 

21 

151 

1.84 

1.51 

2 

II 

1.75 

21 

21 

3.00 

3.00 

1 

25 

1.5000 

1.8421 

2.0000 

10% 

17% 

20% 

Ml 

258 

Ill 

21 

3.11 

2.58 

2.51 

3 

II 

2.51 

2.75 

21 

4.00 

3.00 

1 

25 

2.0000 

2.5788 

311 

20% 

32% 

41% 

M5 

3.2S 

21 

31 

351 

3.26 

31 

J 

II 

3.25 

3.50 

21 

400 

41 

1 

25 

30000 

3.2632 

3.5000 

40% 

45% 

50% 

m 

2.84 

III 

31 

3.11 

2.84 

31 

3 

II 

2.75 

31 

21 

3.01 

3.50 

1 

25 

2.7500 

3.0010 

310 

35% 

41% 

40% 

m 

2.3/ 

111 

31 

251 

2/5 

21 

2 

II 

2.25 

2.51 

31 

2.50 

2.37 

1 

25 

20000 

2.3684 

2.10 

20% 

27% 

30% 

Ml 

1.83 

111 

21 

151 

1.83 

21 

2 

II 

1.75 

1.88 

21 

2.00 

31 

1 

25 

1/500 

1.8347 

2.0000 

15% 

18% 

20% 

2E1X1 

1.28 

111 

21 

1.25 

1.28 

1.25 

1 

II 

1.25 

1.50 

1.00 

1.00 

1.75 

1 

25 

110 

1.2500 

1.2341 

0% 

5% 

6% 

2E2X1 

1.28 

1.1! 

21 

151 

128 

1.25 

1 

II 

4.11 

1.25 

1.50 

1.00 

1.00 

1/5 

1 

25 

10625 

1.2721 

1.5000 

1% 

5% 

10% 

21.10X1 

1.33 

Ill 

21 

125 

1/5 

125 

1 

II 

2.11 

1.25 

1.51 

11 

1.00 

125 

1 

25 

10625 

1.2510 

1  4583 

1% 

5% 

8% 

21X1 

1.44 

1.1! 

21 

1.25 

1/5 

1.25 

1 

II 

1.40 

1.51 

1.00 

1.00 

1.25 

1 

25 

1.0000 

1.2500 

1.4444 

0% 

5% 

8% 

211X1 

1.61 

21 

21 

2.11 

1/5 

1.51 

2 

II 

1.50 

1.50 

31 

1.00 

1.25 

1 

25 

1  5000 

1.6111 

210 

10% 

12% 

20% 

212X1 

13? 

111 

21 

1.51 

1/5 

151 

1 

II 

135 

1.51 

21 

1.00 

125 

1 

25 

1.2510 

1.3684 

1  5000 

5% 

7% 

10% 

156 


Appendix  P:  Delphi  Survey,  Part-2  Response  for  AFSC  2A5X3 


Respondant  Number 

Ouartiles 

1 

2 

3 

4 

5 

6 

I 

i 

3 

15 

11 

12 

13 

1st 

Median 

3rd 

1st! 

Median  1 

3rd! 

Ml 

3.25 

1.00 

485 

325 

3 

55 

4 

58 

323 

325 

323 

41 

5.85 

5.05 

6.86 

3.7ES5 

3.7SS5 

4.0606 

56% 

56% 

56% 

Mi 

3.42 

1.00 

388 

3.42 

: 

55 

2 

58 

3.53 

3.25 

4.25 

3.58 

4.85 

2.25 

1.25 

3,5666 

3.2566 

3  5566 

46% 

45% 

56% 

Ml 

51 

1.00 

188 

4.35 

- 

55 

5 

38 

6,83 

3.38 

5.88 

31 

5.85 

488 

1.88 

3,5666 

4  5866 

5.0606 

46% 

66% 

86% 

M2 

51 

185 

688 

4.35 

4 

55 

2 

88 

6,83 

4.35 

5.88 

51 

6.85 

5.85 

6.66 

4,5656 

5  5666 

6.6686 

66% 

86% 

166% 

M3 

3.21 

185 

355 

385 

: 

55 

3 

88 

3.21 

3.25 

3.55 

4.85 

4.85 

3.21 

1.25 

3.8666 

3.2165 

3  5866 

46% 

44% 

56% 

2A590 

328 

155 

5.00 

353 

: 

55 

4 

88 

328 

325 

32! 

31 

5.88 

32! 

1.25 

3.5686 

3  777! 

3  777! 

56% 

56% 

56% 

Ml 

31 

155 

488 

386 

3 

55 

2 

88 

3,85 

3.38 

3.25 

2.88 

485 

3.55 

1.25 

3.8566 

3  6526 

32566 

46% 

41% 

45% 

M2 

2.85 

155 

288 

2.85 

: 

55 

2 

88 

225 

3.88 

2.88 

2.08 

3.55 

1.25 

2.6686 

23134 

3.0600 

26% 

36% 

43% 

Ml 

SI 

6.55 

688 

685 

? 

55 

'2 

38 

6.83 

6.38 

6.00 

61 

6.85 

61 

6.66 

6.6006 

6.6006 

5.6666 

166% 

166% 

166% 

2A6X0 

31 

2.55 

388 

3.65 

: 

55 

4 

58 

3.58 

3.53 

325 

31 

5.88 

3.25 

1.25 

3.6586 

3.5866 

3  6666 

46% 

56% 

52% 

Ml 

2.45 

155 

255 

2.46 

: 

55 

2 

38 

2.58 

2.25 

2.25 

31 

2.83 

2.55 

1.25 

2.6666 

2.2566 

2  5566 

26% 

25% 

35% 

M2 

1.55 

1.55 

288 

1.36 

: 

55 

2 

38 

2.58 

2.33 

2.25 

21 

3.88 

2.55 

1.25 

.3566 

2.8666 

2.6666 

13% 

26% 

28% 

M3 

285 

155 

158 

283 

: 

55 

2 

38 

2.58 

2.33 

2.35 

2.88 

3.83 

2.75 

1.25 

2.6666 

2166 

2.6666 

26% 

26% 

25% 

Ml 

2.25 

1.55 

258 

2.26 

: 

55 

2 

58 

2.25 

2.25 

2.55 

2.85 

2.55 

2.25 

1.25 

2.6855 

2.2566 

2.2500 

26% 

25% 

25% 

M5 

2.35 

1.55 

358 

2.36 

2 

55 

2 

58 

2,35 

2.25 

2.53 

21 

3.83 

3.55 

1.26 

2.6856 

2.3566 

2.5000 

26% 

27% 

35% 

MS 

2.55 

2.55 

458 

2.53 

2 

55 

2 

58 

3.33 

225 

3.53 

21 

4.83 

2.35 

1.26 

2.5656 

2.3566 

3.6666 

36% 

33% 

43% 

M3 

1.55 

155 

258 

1.35 

i 

55 

2 

38 

2.53 

1.35 

1.35 

31 

2.85 

1.35 

1.25 

.3556 

1  3566 

2.6666 

13% 

13% 

25% 

Ml 

125 

155 

158 

125 

53 

2 

58 

125 

125 

125 

2.85 

1.58 

2.25 

1.25 

.5656 

17566 

1  7566 

16% 

15% 

15% 

2E1X1 

1.31 

2.55 

258 

1.34 

2 

55 

2 

58 

358 

2.38 

1.34 

1.85 

2.35 

1.34 

1.25 

.3444 

2.5050 

2.0606 

13% 

26% 

25% 

2E2X1 

1.31 

2.55 

158 

1.34 

2 

55 

2 

58 

358 

1.35 

1.34 

1.85 

2.85 

1.34 

1.25 

.3656 

1  8444 

2.6666 

18% 

13% 

25% 

21X1 

183 

155 

288 

168 

55 

2 

38 

158 

125 

1.6! 

1.85 

11 

1.25 

1.25 

.2586 

1.5050 

1.6842 

5% 

16% 

14% 

21X1 

1.45 

185 

158 

125 

55 

2 

88 

158 

1.58 

125 

1.55 

1.83 

1.25 

1.25 

.2566 

1.5666 

1  5566 

5% 

16% 

15% 

211X1 

125 

185 

288 

125 

55 

2 

38 

153 

125 

125 

21 

1.83 

1.25 

1.25 

.2586 

17566 

1  7566 

5% 

15% 

15% 

212X1 

11 

185 

158 

125 

1 

65 

2 

88 

155 

155 

125 

21 

1.83 

1.25 

1.25 

.2566 

1.5856 

1  7566 

5% 

16% 

15% 

157 


Appendix  Q:  Delphi  Survey,  Part-2  Response  for  AFSC  2A6X0 


Respondant  Number 

Quartiles 

1 

2 

3 

4 

5 

6 

7 

8 

3 

11 

11 

12 

13 

Is! 

Median 

3rd 

1st! 

Median  1 

3rd% 

Ml 

3.15 

1.11 

31 

31 

2.51 

31 

3 

11 

3.11 

3.11 

2.75 

5.11 

3.11 

4.11 

1.25 

2.8125 

3.11 

3.11 

36% 

41% 

41% 

Ml 

61 

111 

51 

6.1 

5.11 

6.00 

5 

11 

4.11 

6,11 

61 

5.11 

5.11 

6.11 

6.11 

5,11 

5.5111 

6.11 

81% 

31% 

111% 

Ml 

2.53 

111 

31 

3.51 

2.53 

2.51 

3 

11 

3,11 

2,51 

2.75 

41 

4.11 

411 

61 

2  5882 

3.11 

3  8751 

32% 

41% 

58% 

2A3X2 

31 

111 

31 

3.51 

3.11 

21 

: 

11 

3.51 

3.11 

3.25 

41 

4.11 

4.25 

1.25 

3,11 

3.11 

351 

41% 

41% 

51% 

M3 

3.25 

111 

3.11 

355 

3.25 

41 

3 

11 

351 

3.25 

41 

51 

3.51 

5.25 

1.25 

3,1525 

3.3751 

3  8751 

41% 

48% 

58% 

2A590 

111 

51 

6.11 

5.11 

61 

5 

11 

5,11 

6.11 

6.01 

5.11 

5.11 

6.11 

6.11 

5111 

5.1111 

6.11 

81% 

81% 

111% 

Ml 

3.31 

III 

31 

3.51 

331 

31 

: 

11 

351 

3.25 

3.51 

31 

3.51 

5.25 

1.25 

3.1111 

3.2751 

311 

41% 

46% 

51% 

Ml 

31 

III 

3.11 

3.11 

331 

3.11 

: 

11 

3.11 

3.51 

3.11 

3.11 

5.25 

1.25 

3111 

3.11 

3.0526 

41% 

41% 

41% 

M3 

3.21 

III 

3.11 

3.11 

3.21 

3.11 

: 

11 

351 

3.11 

3.75 

21 

4.11 

5.25 

1.25 

3.1111 

3.1111 

34251 

41% 

41% 

43% 

Mi 

61 

6.11 

61 

6.11 

6.11 

61 

6 

11 

6.11 

6.11 

6.00 

61 

6.11 

61 

6.11 

6.1111 

6.1001 

5.11 

111% 

111% 

111% 

1M\ 

336 

2.51 

4.11 

4.75 

3.86 

41 

4 

11 

351 

3.75 

3.86 

4.11 

4.11 

4.75 

1.25 

3.7768 

3.3286 

4.11 

56% 

58% 

61% 

M2 

3.1 

2.11 

4.11 

4.11 

3.51 

3.51 

: 

11 

351 

3.11 

3.25 

3.11 

3.11 

5.25 

1.25 

3.1111 

3.1511 

3.11 

41% 

43% 

51% 

2ASX3 

3.23 

111 

4.11 

3.11 

3.23 

3.11 

: 

11 

3.23 

3.25 

2.25 

2.11 

3.51 

4.51 

1.25 

2.4375 

3.1251 

32857 

28% 

43% 

46% 

1X4 

3.67 

2.51 

4.11 

355 

367 

3.51 

I 

11 

3.67 

361 

3.25 

2.11 

4.11 

4.75 

1.25 

3.3125 

36333 

3.3167 

46% 

53% 

58% 

2/16X5 

3.71 

2.51 

4.11 

4.11 

3.71 

3.51 

2 

51 

3.71 

3.71 

4.11 

2.11 

5.11 

5.11 

1.25 

2.7511 

3.7143 

4.11 

35% 

54% 

61% 

1X6 

3.52 

2.51 

4.11 

4.75 

362 

3.11 

: 

51 

3.62 

3.51 

3.75 

2.11 

4.11 

4.75 

1.25 

3.1251 

36131 

3.3375 

43% 

52% 

53% 

2A7X3 

2.35 

111 

4.11 

3.11 

3.25 

2.51 

3 

11 

351 

2.75 

2.35 

2.11 

4.11 

4.51 

1.25 

2.5625 

2.8762 

34375 

31% 

41% 

43% 

2A7X4 

251 

111 

4.11 

2.11 

261 

2.51 

3 

11 

2.61 

2.51 

2.25 

2.11 

2.11 

4.75 

1.25 

2.1111 

2.5111 

261 

21% 

31% 

32% 

2E1X1 

1.74 

111 

3.11 

1.75 

1.74 

1.51 

2 

11 

1.74 

1.75 

1.74 

1.11 

1.11 

1.74 

1.25 

.3125 

1.7368 

1.7467 

6% 

15% 

15% 

m 

1.74 

111 

31 

1.75 

1.74 

1.51 

2 

11 

1,74 

1.75 

1.51 

1.15 

111 

1.74 

1.25 

.3125 

1  7368 

1.7467 

6% 

15% 

15% 

21X1 

1.35 

111 

31 

2.11 

1.35 

1.51 

2 

11 

2,11 

2,11 

1.75 

1.15 

111 

1.25 

1.25 

.2511 

1.8511 

2.11 

5% 

17% 

21% 

21X1 

157 

111 

31 

155 

2.11 

1.51 

2 

11 

1,67 

161 

1.75 

1.15 

111 

1.67 

1.25 

.3125 

1.5333 

17282 

6% 

13% 

15% 

211X1 

2.13 

111 

3.11 

2.25 

2.13 

2.11 

3 

11 

2,13 

2.11 

1.75 

2.11 

2.11 

3.11 

1.25 

2,11 

211 

21315 

21% 

21% 

24% 

212X1 

1.86 

111 

3.11 

2.11 

186 

1.51 

2 

11 

1.86 

175 

1.75 

21 

111 

186 

1.25 

.5625 

1.8571 

13643 

11% 

17% 

15% 

158 


Appendix  R:  Delphi  Survey,  Part-2  Response  for  AFSC  2A6X1 


Respondant  Number 

Quartiles 

1 

2 

3 

4 

5 

6 

7 

8 

3 

11 

11 

12 

13 

14 

Is! 

Median 

3rd 

M 

Median  % 

3rd% 

Ml 

2.15 

111 

2.11 

21 

215 

2.11 

21 

215 

211 

2.15 

31 

3.11 

2.15 

1 

25 

2,11 

2.1251 

21511 

21% 

21% 

21% 

Ml 

315 

111 

1.11 

415 

315 

3.51 

41 

315 

3.51 

4.25 

31 

5.11 

3.11 

1 

25 

3.1251 

31511 

4.1111 

43% 

55% 

61% 

m 

2.25 

111 

21 

31 

226 

2.11 

21 

2.26 

2.25 

2.51 

31 

3.11 

2.26 

1 

25 

2,11 

2.2632 

2  4418 

21% 

25% 

23% 

n 

2.35 

111 

2.11 

31 

235 

2.11 

21 

2.35 

2.25 

2.51 

31 

3.11 

2.11 

1 

25 

2,1111 

2.3111 

24625 

21% 

26% 

23% 

m 

31 

111 

1.11 

41 

311 

3.11 

31 

3,41 

3.25 

315 

41 

3.51 

215 

1 

25 

3.0000 

3.3251 

3  6875 

41% 

47% 

54% 

2A590 

3.51 

111 

1.11 

51 

3.51 

3.51 

41 

3,84 

315 

4.25 

31 

5.11 

3.11 

1 

25 

3.1250 

31361 

41111 

43% 

56% 

61% 

Ml 

3,45 

111 

4.11 

41 

3.45 

3.11 

31 

3,45 

3.25 

315 

31 

3.51 

3.11 

1 

25 

33111 

3.3511 

34875 

41% 

47% 

51% 

M2 

3.12 

111 

4.11 

31 

3.25 

3.11 

31 

3.25 

3.51 

31 

3.11 

2.11 

1 

25 

31111 

31111 

32511 

41% 

41% 

45% 

M3 

2.1 

111 

2.11 

21 

2.41 

2.11 

21 

2.43 

2.25 

2.51 

21 

3.11 

2.25 

1 

25 

2.1111 

2.2511 

24111 

21% 

25% 

28% 

Ml 

4.11 

11 

4.11 

51 

4.44 

3.51 

41 

4.44 

4.25 

4.25 

51 

415 

411 

1 

25 

4.1111 

4.2511 

4  4444 

51% 

65% 

63% 

Ml 

5.51 

61 

61 

51 

Ell 

6.11 

61 

611 

6.11 

6.11 

61 

6.11 

6.11 

6 

11 

6.1111 

6.1001 

6.1111 

111% 

111% 

111% 

2ASX2 

2.33 

11 

2.11 

31 

2.33 

2.11 

21 

2.53 

2.25 

215 

21 

3.11 

2.51 

1 

25 

2.1111 

2.2311 

2.5111 

21% 

26% 

31% 

2ASX3 

2.14 

131 

2.11 

21 

2.14 

2.11 

21 

2.14 

2.11 

2.14 

21 

3.11 

2.15 

1 

25 

2.1111 

2.1111 

2.1423 

21% 

21% 

23% 

Ml 

2.57 

11 

3.11 

41 

2.67 

2.51 

31 

3.51 

2.51 

2.51 

21 

3.11 

3.11 

1 

25 

2.5111 

2.6667 

31111 

31% 

33% 

41% 

1X5 

235 

2.11 

2.11 

41 

235 

2.51 

31 

311 

215 

3.25 

21 

3.11 

235 

1 

25 

2.1251 

2.3524 

3.1111 

23% 

33% 

41% 

MIX! 

215 

111 

2.11 

31 

216 

2.51 

31 

215 

215 

216 

2.11 

3.11 

216 

1 

25 

2.1251 

2.7613 

2.7613 

23% 

35% 

35% 

M3 

2.14 

111 

2.11 

21 

2.14 

2.11 

21 

2.14 

2.11 

2.14 

21 

2.11 

2.14 

1 

25 

2.1111 

2.1511 

21423 

21% 

21% 

23% 

1X4 

131 

111 

2.11 

115 

131 

1.51 

21 

131 

115 

131 

21 

1.11 

131 

1 

25 

1.5625 

13148 

1.9048 

11% 

18% 

18% 

2E1X1 

1.55 

111 

21 

11 

1.55 

1.51 

21 

155 

151 

1.51 

11 

1.11 

1.55 

1 

25 

1.3125 

1.5111 

1.5511 

6% 

11% 

11% 

1X1 

1.53 

111 

11 

1.53 

1.51 

21 

153 

1.51 

1.51 

11 

1.11 

1.53 

1 

26 

1.2611 

1.5111 

1.5263 

5% 

11% 

11% 

21X1 

115 

111 

2.11 

1.53 

115 

1.51 

21 

115 

115 

1.51 

11 

1.11 

1.25 

1 

25 

1.2511 

1.5111 

17511 

5% 

11% 

16% 

21X1 

135 

111 

21 

11 

115 

1.51 

11 

151 

1.35 

1.51 

11 

1.11 

1.25 

1 

25 

1,1625 

1.3655 

111 

1% 

7% 

11% 

211X1 

1.52 

111 

2.11 

11 

1.62 

1.51 

11 

153 

151 

1.51 

21 

1.11 

1.25 

1 

25 

12511 

1.5111 

1  5833 

5% 

11% 

12% 

212X1 

1.51 

111 

2.11 

11 

115 

1.51 

21 

151 

151 

1.51 

21 

1.11 

1.25 

1 

25 

1.3125 

1.5111 

1  6875 

6% 

11% 

14% 

159 


Appendix  S:  Delphi  Survey,  Part-2  Response  for  AFSC  2A6X2 


Respondant  Number 

Quartiles 

1 

2 

3 

4 

5 

6 

7 

1 

3 

11 

11 

12 

13 

14 

1st 

Median 

3rd 

1st! 

Median  % 

Ml 

2.32 

1.1 

2.11 

261 

2.32 

2.11 

2.11 

2.32 

225 

2.11 

261 

2.51 

2.32 

1.25 

26115 

26116 

2.2333 

21% 

21% 

26% 

m 

3.32 

111 

3.11 

361 

3.32 

3.11 

3.11 

3.25 

3.25 

3.51 

2.11 

3.51 

1.51 

1.25 

2.2615 

36116 

32511 

25% 

41% 

45% 

Ml 

2.21 

1.1 

2.11 

361 

2.21 

2.11 

2.11 

2.21 

221 

2.11 

2.11 

2.51 

1.51 

1.26 

26115 

26116 

2.2573 

21% 

21% 

24% 

m 

226 

1.1 

2.11 

361 

2.26 

2.11 

2.11 

2.26 

2.11 

2.26 

265 

2.51 

1.51 

1.25 

26115 

26116 

2.2632 

21% 

21% 

25% 

M3 

2.23 

1.1 

3.11 

361 

271 

2.51 

3.11 

271 

275 

2.51 

2.11 

2.51 

151 

1.25 

2.1255 

2.5256 

27835 

23% 

33% 

36% 

2A590 

3.33 

1.1 

3.11 

3.51 

3.31 

2.11 

3.11 

3.33 

3.25 

3.25 

2.15 

2.51 

2.11 

1.25 

26115 

36116 

3.3542 

21% 

41% 

47% 

Ml 

2.23 

161 

3.11 

361 

271 

2.51 

3.11 

275 

2.75 

2.51 

365 

2.51 

2.11 

1.25 

2.1256 

2.7516 

2.3474 

23% 

35% 

33% 

m 

2.6? 

161 

3.11 

361 

267 

2.51 

3.11 

2,51 

2.51 

365 

1.51 

2.11 

1.25 

26115 

2.5116 

3.6111 

21% 

31% 

41% 

m 

2.37 

1.11 

2.11 

2.51 

2.51 

2.11 

2 

11 

2.25 

2.25 

2.25 

265 

1.51 

1.51 

1.25 

1.6256 

26116 

2.2511 

13% 

21% 

25% 

Ml 

363 

1.11 

3.11 

4.11 

361 

3.51 

1 

11 

4.75 

3.75 

3.51 

465 

3.51 

1.75 

1.25 

3.6116 

31256 

3.3737 

41% 

53% 

53% 

Ml 

273 

161 

3.11 

3.51 

271 

2.51 

: 

11 

361 

275 

2.25 

3.15 

2.51 

2.25 

2.73 

2.5116 

27635 

3.6111 

31% 

36% 

41% 

M2 

61 

661 

6.11 

6.11 

6.11 

6.01 

l 

11 

6.11 

6.11 

6.11 

665 

6.51 

6.11 

6 

15 

66116 

6.6005 

6.6111 

111% 

111% 

111% 

Ml] 

2.11 

161 

2.11 

175 

2.11 

2.11 

2 

11 

2.11 

2.11 

2.11 

265 

2.51 

2.11 

1 

25 

26116 

26116 

26751 

21% 

21% 

22% 

m 

2.4S 

1.11 

2.11 

2.51 

2.11 

2.11 

: 

11 

2,45 

2.25 

2.25 

265 

2.51 

2.11 

1 

25 

26116 

26116 

22511 

21% 

21% 

25% 

1X5 

261 

2.11 

3.11 

3.55 

231 

2.51 

3 

11 

261 

2.75 

2.25 

265 

3.51 

261 

1 

25 

2.3125 

2.6115 

2.3511 

26% 

36% 

33% 

MS 

31 

2.11 

3.11 

3.55 

3.11 

2.51 

3 

11 

3.11 

3.11 

2.75 

265 

2.51 

2.25 

1 

25 

26625 

2.8756 

3.6111 

21% 

36% 

41% 

M3 

221 

161 

3.11 

2.55 

2.21 

2.11 

2 

11 

361 

2.11 

2.21 

365 

2.51 

2.21 

1 

25 

26116 

2.2116 

24251 

21% 

24% 

23% 

Ml 

165 

1.11 

2.11 

1.55 

165 

1.51 

2 

11 

2.11 

1.75 

1.75 

265 

1.51 

165 

1 

25 

1.5116 

1.6116 

1.3625 

11% 

16% 

13% 

11X1 

1.51 

161 

2.11 

1.55 

1.51 

1.51 

1 

11 

1.51 

1.51 

1.51 

165 

1.51 

1.51 

1 

25 

16625 

15116 

1.5511 

1% 

11% 

11% 

m\ 

1.51 

161 

2.11 

1.55 

1.51 

1.51 

1 

11 

1.51 

1.51 

1.51 

165 

1.51 

151 

1 

25 

16625 

1.5116 

1.5511 

1% 

11% 

11% 

21X1 

153 

1.11 

2.11 

1.55 

163 

1.51 

2 

11 

163 

161 

1.51 

165 

1.51 

1.25 

1 

25 

1.2516 

1.5116 

15316 

5% 

11% 

13% 

21X1 

175 

161 

2.11 

2.11 

175 

1.51 

2 

11 

1.75 

1.75 

1.75 

165 

1.51 

1.25 

1 

25 

1.2516 

1.7516 

17511 

5% 

15% 

15% 

211X1 

2.11 

161 

2.11 

2.11 

2.11 

2.11 

2 

11 

2.11 

2.11 

1.51 

265 

1.51 

1.25 

1 

25 

1,3125 

26115 

2.6751 

6% 

21% 

22% 

212X1 

11 

11 

2.11 

1.55 

161 

1.51 

2 

11 

161 

1.75 

1.51 

265 

1.51 

1.25 

1 

25 

1.3125 

1.5255 

1.8111 

6% 

13% 

16% 

160 


Appendix  T:  Delphi  Survey,  Part-2  Response  for  AFSC  2A6X3 


Respondant  Number 

Quartiles 

1 

2 

3 

4 

5 

6 

I 

8 

3 

11 

11 

12 

13 

Is! 

Median 

3rd 

1st! 

Median  1 

3rd! 

Ml 

2.11 

1 

ii 

1.1! 

261 

26! 

21 

2 

II 

261 

2,11 

21 

21 

366 

21 

1 

25 

261 

211 

211 

21% 

21% 

20% 

Ml 

3.11 

1 

ii 

2.11 

361 

3.11 

31 

3 

II 

3.51 

361 

3.25 

21 

461 

1.61 

1 

25 

261 

3611! 

3.100! 

21% 

41% 

42% 

Ml 

1.31 

1 

ii 

11 

115 

131 

1.51 

2 

II 

131 

115 

2.25 

21 

361 

1.51 

1 

25 

51 

1.8251 

1  3751 

11% 

17% 

21% 

M2 

13! 

1 

ii 

1.11 

115 

131 

1.51 

2 

II 

131 

115 

11 

2.16 

36! 

1.61 

1 

25 

,5111 

1.8251 

1.9000 

11% 

17% 

18% 

Ml 

216 

1 

ii 

2.11 

361 

215 

2.51 

3 

II 

215 

2.61 

2.25 

21 

361 

1.51 

1 

25 

261 

2.5511 

2  7511 

21% 

31% 

35% 

2A590 

2.61 

1 

ii 

2.1! 

361 

2.84 

2.51 

3 

II 

2.84 

215 

2.25 

21 

361 

1.51 

1 

25 

26111 

2.6251 

2.8421 

21% 

33% 

37% 

Ml 

2.46 

1 

ii 

2.11 

361 

2.45 

21 

: 

II 

2.45 

2.25 

2.25 

2.16 

361 

1.51 

1 

25 

26611 

2.2511 

24511 

21% 

25% 

29% 

M2 

2.11 

1 

ii 

1.11 

2.51 

2.11 

21 

2 

II 

261 

211 

2.16 

111 

1.51 

1 

25 

.251! 

2.11 

2.1053 

5% 

21% 

22% 

2A5X3 

13! 

1 

ii 

1.11 

261 

111 

21 

2 

II 

11 

115 

131 

2.16 

111 

1.51 

1 

25 

.3375 

111 

1.9751 

7% 

18% 

21% 

Ml 

3.86 

1 

ii 

3.11 

461 

3.85 

3.51 

4 

II 

3.85 

3.15 

31 

5.16 

511 

315 

1 

25 

3.1256 

3.81 

3.9625 

43% 

56% 

59% 

Ml 

2.4! 

1 

ii 

1.11 

261 

2.4! 

21 

2 

II 

2.41 

2.25 

2.25 

3.16 

111 

31 

1 

25 

.4375 

2.125! 

241 

9% 

23% 

28% 

M2 

1.81 

1 

ii 

1.11 

261 

1.81 

1.51 

2 

II 

1.86 

115 

11 

2.16 

211 

181 

1 

25 

.5625 

1.81 

1.951! 

11% 

16% 

19% 

M3 

661 

6 

ii 

61 

661 

661 

61 

2 

II 

666 

661 

61 

6.11 

611 

61 

6 

II 

6.6001 

661 

511 

111% 

111% 

1% 

Ml 

266 

1 

ii 

111 

2.51 

265 

21 

2 

II 

265 

261 

2.15 

2.16 

311 

115 

1 

25 

.8125 

2.1! 

26476 

16% 

21% 

21% 

2/16X5 

2.14 

1 

ii 

1.1! 

361 

2.14 

21 

2 

II 

2.14 

2.11 

2.14 

2.16 

211 

115 

1 

25 

.8125 

2.1! 

2.1429 

16% 

21% 

23% 

2/16X6 

2.38 

2 

ii 

21 

3.61 

238 

21 

2 

II 

2.38 

2.25 

2.25 

2.16 

31! 

115 

1 

25 

2.6001 

2.125! 

2.381! 

21% 

23% 

28% 

M3 

131 

1 

ii 

21 

2.25 

131 

1.51 

2 

II 

11 

115 

131 

2.16 

Ill 

115 

1 

25 

.5625 

Ill 

1.975! 

11% 

18% 

21% 

Ml 

2.52 

2 

ii 

21 

461 

2.52 

21 

1 

II 

2.52 

2.25 

3.25 

2.16 

311 

2.15 

1 

26 

261 

2.3863 

2  6935 

21% 

28% 

34% 

2E1X1 

1.32 

2 

ii 

11 

1.51 

132 

1.25 

1 

II 

1.32 

1.25 

1.51 

1.16 

111 

1.32 

1 

25 

6625 

1.2823 

1.3158 

1% 

6% 

6% 

2E2X1 

132 

2 

ii 

11 

1.56 

132 

1.25 

1 

II 

1.32 

125 

1.51 

1.16 

111 

1.32 

1 

26 

6625 

1.2823 

1.315! 

1% 

6% 

6% 

21X1 

11 

2 

ii 

11 

151 

1.41 

1.25 

1 

II 

1.46 

1.25 

1.51 

1.16 

111 

141 

1 

26 

6625 

1  3251 

1.4000 

1% 

7% 

8% 

21X1 

1.48 

1 

ii 

11 

1.51 

1.48 

1.48 

2 

II 

1.48 

1.31 

1.51 

1.16 

1.1! 

1.25 

1 

25 

6625 

1  3881 

1  4762 

1% 

8% 

11% 

211X1 

116 

; 

ii 

11 

1.51 

116 

1.51 

2 

II 

116 

151 

115 

21 

1.61 

1.51 

1 

25 

,5111 

1.6256 

1.7619 

11% 

13% 

15% 

2W2X1 

1.43 

i 

ii 

11 

1.51 

143 

1.25 

1 

II 

1.43 

151 

1.51 

2.16 

1.66 

1.25 

1 

25 

6625 

1.3333 

1  4821 

1% 

7% 

10% 

161 


Appendix  U:  Delphi  Survey,  Part-2  Response  for  AFSC  2A6X4 


Respondant  Number 

Quartiles 

1 

2 

3 

4 

5 

6 

7 

8 

3 

1! 

11 

12 

13 

1st 

Median 

3rd 

M 

Median  % 

3rd! 

MIX1 

11 

1 

II 

1.1) 

1.51 

13) 

1.5) 

2 

1) 

111 

2 

1! 

1.5) 

21 

31 

1.3! 

1.25 

.51 

111 

1376! 

11% 

18% 

20% 

Ml 

325 

1 

II 

1.11 

2.51 

3.25 

31 

3 

1! 

4.75 

3 

1! 

3.5! 

21 

41 

21 

1.25 

2.125! 

3.011! 

34375 

23% 

41% 

43% 

2A3X1 

225 

1 

II 

21 

2.51 

2.25 

21 

2 

II 

2.25 

2 

1! 

21 

21 

31 

1.5) 

1.25 

2111 

2.0511 

2251! 

21% 

21% 

25% 

2A3X2 

225 

1 

II 

21 

2.51 

2.25 

21 

2 

II 

2.25 

2 

1! 

2.5! 

21 

31 

1.51 

1.25 

211! 

2.0511 

22511 

21% 

21% 

25% 

M3 

2.31 

1 

II 

31 

31 

231 

2.51 

3 

II 

231 

3 

5! 

2.31 

21 

31 

2.75 

1.25 

2.5010 

211 

2  3751 

31% 

38% 

40% 

2A590 

321 

1 

II 

11 

3.1 

3.21 

2.5! 

: 

II 

4.75 

3 

I! 

3.21 

21 

31 

2.25 

1.25 

2.3125 

3.0111 

32105 

26% 

41% 

44% 

2A5X1 

235 

1 

II 

31 

3.1 

235 

2.51 

: 

11 

3.51 

2 

75 

2.35 

31 

3.1! 

2.75 

1.25 

]7I 

2  3511 

3.0000 

35% 

33% 

40% 

2A5X2 

2.83 

1 

II 

31 

2.51 

21 

2.5! 

: 

11 

2 

75 

2.75 

31 

21 

2.75 

1.25 

2.5000 

2.7511 

2.8347 

31% 

36% 

38% 

M3 

2.32 

1 

II 

21 

2.1 

232 

21 

2 

11 

232 

2 

25 

2.5! 

21 

11 

1.5! 

1.25 

.625! 

2.01 

22333 

13% 

21% 

26% 

Mi 

3.73 

1 

II 

41 

4.1 

3.73 

3.5! 

4 

11 

4.75 

2 

75 

3.5! 

51 

61 

3.75 

1.25 

3.5625 

3.7835 

411 

51% 

56% 

61% 

M6X1 

2.81 

1 

II 

3.11 

3.1 

2.81 

21 

: 

II 

2.84 

2 

75 

2.5! 

31 

2.5! 

3.25 

1.25 

2.51 

2.8421 

3.0000 

31% 

37% 

40% 

Mil 

2.32 

1 

II 

31 

3.1 

2.32 

21 

2 

11 

2.25 

2 

2! 

2.25 

21 

31 

2.32 

1.25 

21! 

2.251! 

2.3158 

21% 

25% 

26% 

Mi] 

2.16 

1 

II 

11 

2.5) 

2.16 

21 

: 

II 

2.16 

2 

1! 

2.16 

21 

21 

1.75 

1.25 

.8125 

211 

2.1573 

16% 

21% 

23% 

Ml 

6.11 

6 

II 

61 

6.1 

6.1! 

61 

5 

II 

6.1 

2 

1! 

61 

61 

61 

61 

61 

611! 

6.11 

61! 

111% 

111% 

111% 

Mi 

235 

2 

II 

2.11 

3.51 

2.65 

2.5! 

3 

II 

235 

3 

1! 

2.5! 

21 

31 

2.25 

1.26 

2.0525 

2.575! 

23881 

21% 

32% 

40% 

MIX! 

231 

1 

II 

31 

3.1 

23) 

2.5! 

3 

11 

23! 

2 

75 

2.5! 

21 

31 

2.25 

1.25 

2.3125 

2.8274 

2  3762 

26% 

37% 

40% 

M7X3 

21 

1 

II 

21 

2.51 

3.25 

21 

2 

II 

2.11 

2 

1! 

2.1! 

21 

21 

1.75 

1.25 

2.11 

21! 

2.0352 

21% 

21% 

22% 

MIX! 

1.71 

1 

II 

11 

1.51 

1.71 

1.5! 

2 

11 

1.71 

1 

5! 

1.75 

21 

11 

1.5! 

1.25 

.3125 

1.51 

1.7143 

6% 

11% 

14% 

2E1X1 

132 

I 

II 

11 

1.51 

1.32 

1.25 

1 

11 

1.51 

* 

25 

1.5) 

11 

111 

1.32 

1.25 

111 

1.2511 

1.3158 

1% 

5% 

6% 

2E2X1 

132 

1 

II 

1.11 

1.51 

132 

1.25 

1 

11 

1.51 

1 

25 

1.51 

11 

11 

1.32 

1.25 

.0000 

1.251! 

1.316! 

1% 

5% 

6% 

21X1 

1.61 

1 

II 

1.11 

151 

16! 

1.51 

2 

11 

1.61 

5! 

1.5) 

11 

11 

1.75 

1.25 

.0625 

151 

161 

1% 

11% 

12% 

21X1 

133 

1 

II 

1.1! 

1.51 

1.33 

1.25 

1 

II 

1.25 

' 

25 

1.51 

11 

11 

1.33 

1.25 

1! 

1.2511 

1.3333 

1% 

5% 

7% 

211X1 

1.52 

1 

II 

11 

1.51 

1.52 

1.52 

1 

11 

1.25 

5! 

1.51 

21 

11 

1.25 

1.25 

,0626 

1.3751 

1.5173 

1% 

8% 

10% 

212X1 

1.46 

1 

II 

11 

1.51 

148 

1.48 

1 

II 

1.25 

1 

5! 

1.51 

21 

11 

1.25 

1.25 

,0625 

1.3631 

141 

1% 

7% 

10% 

162 


Appendix  V:  Delphi  Survey,  Part-2  Response  for  AFSC  2A6X5 


Respondant  Number 

Quartiles 

1 

2 

3 

4 

5 

6 

7 

8 

8 

11 

11 

12 

13 

14 

l5i 

Median 

3rd 

lit! 

Median  % 

3fd% 

Ml 

21 

111 

2.11 

1.75 

2.11 

2.11 

21 

21 

1 

35 

21 

21 

3.11 

21 

1 

25 

1.3625 

2.1111 

2.11 

18% 

21% 

21% 

m 

3.65 

111 

31 

2.51 

3.65 

3.51 

41 

3,65 

3 

51 

3.65 

2.11 

5.11 

21 

1 

25 

2,1251 

3.5111 

3  6511 

23% 

51% 

53% 

Ml 

2.15 

111 

2.11 

2.51 

2.15 

2.11 

21 

2.15 

2 

11 

2.51 

21 

3.11 

1.51 

25 

211 

2.1511 

21511 

21% 

21% 

23% 

m 

2.15 

1.11 

2.11 

2.51 

2.15 

21 

21 

2.15 

2 

11 

2.25 

2.11 

3.11 

1.51 

1 

25 

2.11 

2.1511 

211 

21% 

21% 

23% 

M3 

3.51 

111 

31 

3.11 

3.11 

3.51 

41 

3.51 

3 

25 

3.25 

21 

4.11 

2.75 

1 

25 

2.8125 

3.1250 

3.5000 

36% 

43% 

51% 

2AS90 

3.81 

111 

3.11 

3.11 

3.51 

3.51 

41 

3,84 

3 

75 

3.51 

21 

411 

3.11 

1 

25 

3.0000 

3.5111 

3.8181 

41% 

51% 

56% 

Ml 

3.65 

111 

3.11 

3.11 

3.25 

3.51 

41 

3.65 

3 

51 

3.25 

4.11 

3.11 

2.75 

1 

25 

3.1111 

3.2511 

3.6125 

41% 

45% 

52% 

M2 

3.3/ 

111 

3.11 

2.51 

3.37 

3.11 

31 

: 

25 

3.75 

31 

3.11 

2.75 

1 

25 

2,7611 

3.0000 

32511 

35% 

41% 

46% 

Ml 

2.21 

111 

2.11 

2.55 

2.21 

2.11 

21 

2.21 

i 

11 

2.25 

21 

111 

1.51 

25 

76251 

2.11 

2.2000 

13% 

21% 

24% 

Ml 

1.21 

III 

4.11 

4.11 

4.21 

3.51 

41 

4.75 

4 

11 

41 

5.11 

5.11 

4.21 

1 

25 

4.0000 

41111 

4.21 

61% 

61% 

64% 

Ml 

31 

111 

3.11 

3.11 

3.11 

2.51 

3.11 

31 

2 

75 

3.11 

31 

2.81 

3.25 

1 

26 

2,7625 

3.11 

3.1111 

35% 

41% 

41% 

Mil 

2.51 

III 

3.11 

3.11 

2.51 

2.51 

21 

2.51 

2 

25 

2.51 

21 

3.11 

2.51 

1 

25 

2.1625 

2.5111 

2.5111 

21% 

31% 

31% 

Ml] 

1.35 

111 

21 

1.75 

1.35 

1.51 

21 

1.35 

2 

11 

1.35 

2.11 

2.11 

1.75 

1 

25 

1.7511 

73511 

2.0000 

15% 

18% 

21% 

im 

2.78 

111 

2.11 

3.51 

2.78 

2.51 

3 

11 

2,73 

3 

78 

2.51 

21 

4.11 

2.25 

1 

25 

2,1625 

2.6447 

2  7885 

21% 

33% 

36% 

1X5 

61 

6.11 

6.11 

6.11 

6.11 

6.00 

6 

11 

6.1 

6 

II 

6.01 

61 

6.11 

6.11 

6 

11 

6.1111 

6.11 

6.11 

111% 

111% 

111% 

1X6 

2.76 

111 

2.11 

3.55 

2.76 

2.51 

3 

II 

3.11 

2 

75 

2.51 

41 

3.11 

1.75 

l 

25 

2.1250 

2.7561 

3.1111 

23% 

35% 

41% 

2A7X3 

21 

111 

2.11 

3.11 

2.11 

2.11 

2 

11 

2.25 

2 

11 

2.11 

21 

111 

1.75 

1 

26 

1.8125 

2.11 

2.1352 

16% 

21% 

22% 

m 

1.67 

III 

2.11 

1.55 

1.67 

1.51 

2 

11 

1.67 

1 

61 

175 

2.11 

111 

1.51 

1 

25 

45000 

76333 

1.7232 

11% 

13% 

15% 

11X1 

1.21 

111 

111 

1.55 

1.21 

1.51 

1 

11 

1.25 

1.21 

125 

1.11 

111 

1.21 

1 

25 

111 

1.21 

12511 

1% 

4% 

5% 

m 

1.21 

111 

111 

1.55 

1.21 

125 

1 

11 

1.25 

1.21 

125 

111 

111 

1.21 

1 

25 

111 

72111 

12511 

1% 

4% 

5% 

1X1 

1.45 

III 

111 

1.55 

1.45 

1.25 

1 

11 

1.51 

1.31 

1.51 

11 

111 

1.45 

1 

25 

111 

72751 

1.4511 

1% 

6% 

8% 

1X1 

1.51 

111 

21 

1.55 

1.51 

1.51 

1 

11 

1.51 

1.51 

151 

1.11 

111 

1.25 

1 

25 

1.1625 

1.51 

411 

1% 

11% 

11% 

1X1 

1.81 

111 

2.11 

1.55 

1.81 

151 

2 

11 

1,81 

1.75 

175 

21 

111 

725 

1 

25 

1,3125 

471 

18185 

6% 

15% 

16% 

1X1 

1.52 

III 

2.11 

1.55 

1.52 

1.52 

1 

11 

1.52 

1.51 

175 

21 

111 

725 

1 

25 

72511 

75113 

1.5238 

5% 

11% 

11% 
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Appendix  W:  Delphi  Survey,  Part-2  Response  for  AFSC  2A6X6 


Respondant  Number 

Quantiles 

1 

2 

3 

4 

5 

6 

7 

1 

3 

11 

11 

12 

13 

14 

1st 

Median 

3rd 

1st* 

lledian  % 

3fd% 

Ml 

2.71 

1.11 

4.11 

361 

271 

2.51 

31 

2.71 

2.71 

2.75 

31 

411 

2.71 

1 

25 

2.7000 

2.71 

311 

3416 

34% 

41% 

Mi 

3.25 

111 

51 

361 

3.25 

31 

31 

3,51 

3.11 

3.51 

31 

411 

21 

1 

25 

111 

3.1250 

311 

«. 

43% 

51% 

Ml 

3.15 

111 

5.11 

3.51 

2.25 

2.51 

31 

3.51 

311 

3.51 

31 

411 

3.15 

25 

26251 

31751 

3.11 

33% 

42% 

51% 

Ml 

3.15 

1.11 

5.11 

3.51 

2.25 

2.51 

31 

3.51 

311 

3.51 

21 

411 

3.15 

1 

25 

2.3125 

31751 

3.51 

26% 

42% 

51% 

M3 

31 

111 

41 

3.51 

275 

2.51 

31 

311 

311 

31 

21 

411 

3.11 

1 

25 

2.5625 

3111 

311 

31% 

41% 

41% 

2A590 

3.61 

111 

5.11 

411 

366 

3.51 

41 

3.51 

3.51 

375 

21 

411 

3.11 

1 

25 

3.1250 

3.5321 

3.3375 

43% 

52% 

53% 

Ml 

3.16 

111 

41 

311 

311 

31 

31 

3.51 

2.75 

3.16 

31 

311 

3.16 

1 

25 

311 

3.11 

31556 

41% 

41% 

41% 

ML 

2.34 

111 

41 

311 

2.34 

2.51 

31 

2,75 

3.51 

31 

211 

2.34 

1 

25 

2.5111 

2.3444 

311 

31% 

33% 

41% 

m 

3.37 

111 

41 

3.51 

3.37 

2.11 

31 

3.51 

3.25 

3.75 

21 

311 

2.11 

1 

25 

2.2511 

3.1251 

34671 

25% 

43% 

43% 

Ml 

3.35 

1.11 

51 

475 

3.35 

3.51 

41 

4.75 

3.75 

3.75 

51 

511 

3.35 

1 

25 

3.7510 

3.3474 

47511 

55% 

53% 

75% 

Ml 

235 

111 

4.11 

3.11 

2.35 

2.51 

31 

3.51 

2,71 

2.35 

31 

275 

2.35 

1 

25 

2,7125 

2.3474 

311 

34% 

33% 

41% 

M2 

2.42 

1.11 

3.11 

3.11 

2.42 

2.11 

21 

3.11 

2.42 

2.25 

21 

311 

3.51 

1 

25 

211 

2.4211 

311 

21% 

28% 

41% 

M3 

2.47 

111 

21 

275 

2.47 

21 

21 

2,47 

2.25 

2.75 

21 

311 

1.75 

1 

25 

211 

2.1251 

2.4737 

21% 

23% 

23% 

M4 

274 

111 

31 

3.25 

274 

2.51 

3 

11 

3,11 

2.74 

2.74 

21 

411 

2.25 

1 

25 

2.3125 

2.7368 

311 

26% 

35% 

41% 

im 

235 

1.11 

3.11 

3.11 

2.35 

2.51 

3 

11 

3.11 

2.75 

2.51 

41 

311 

2.25 

1 

25 

2.51 

2.3474 

311 

31% 

33% 

41% 

M6 

631 

61 

61 

6.11 

Ell 

61 

5 

11 

6.11 

611 

61 

61 

611 

61 

6 

II 

611 

6.11 

611 

111% 

111% 

111% 

2A7X3 

135 

111 

2.11 

2.15 

1.35 

1.51 

2 

11 

2.25 

1,75 

1.35 

21 

111 

1.75 

l 

26 

1.5625 

1  3524 

211 

11% 

13% 

21% 

m 

171 

111 

2.11 

175 

1.71 

1.51 

2 

11 

1.71 

161 

1.71 

21 

211 

1.75 

1 

25 

1.6286 

1.7143 

1.3375 

13% 

14% 

13% 

2E1X1 

1.83 

21 

2.11 

1.55 

1.83 

1.51 

2 

11 

183 

475 

1.83 

11 

211 

2.25 

1 

25 

1.5625 

1.8347 

211 

11% 

18% 

21% 

2E2X1 

174 

2.11 

2.11 

1.55 

174 

1.51 

: 

11 

174 

475 

1.74 

111 

211 

2.11 

1 

25 

1.5532 

1.7368 

211 

11% 

15% 

21% 

211 

131 

2.11 

2.11 

455 

1.31 

1.51 

2 

11 

1.31 

1.75 

1.31 

11 

211 

2.11 

1 

25 

1.5625 

1.3111 

211 

11% 

18% 

21% 

21X1 

1.47 

111 

31 

455 

1.45 

1.25 

1 

11 

147 

1.41 

1.51 

III 

111 

1.51 

1 

25 

11625 

1.4251 

1.4334 

1% 

3% 

11% 

211X1 

285 

1.11 

3.11 

2.55 

215 

2.11 

2 

15 

1.51 

2,11 

2.15 

21 

111 

1.51 

1 

25 

45000 

21111 

21511 

11% 

21% 

21% 

212X1 

167 

111 

3.11 

2.11 

167 

1.51 

2 

11 

1.51 

161 

1.75 

21 

111 

1.25 

1 

25 

1.3125 

1.6333 

1.3375 

6% 

13% 

13% 
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Appendix  X:  Delphi  Survey,  Part-2  Response  for  AFSC  2A7X3 


Respondant  Uumber 

Quantiles 

1 

2 

3 

4 

5 

6 

7 

8 

5 

10 

11 

12 

13 

14 

tii 

Median 

3rd 

1st! 

Median  % 

m 

Ml 

1.55 

1.00 

31 

1.75 

135 

1.50 

21 

135 

1 

90 

1.75 

21 

3.00 

1.75 

1 

25 

1.7500 

1.9237 

1.9868 

15% 

18% 

20% 

m 

3.11 

100 

41 

3.00 

3.00 

3.00 

31 

3.51 

2 

75 

3.00 

2.10 

4.01 

1.75 

1 

25 

2,1876 

3  0000 

3.0000 

24% 

40% 

40% 

Ml 

2.1S 

100 

3.00 

2.00 

2.18 

2.00 

21 

2.25 

2 

00 

2.16 

21 

3.01 

1.75 

25 

2.0000 

2.0010 

21579 

20% 

20% 

23% 

M2 

2.22 

1.00 

3.00 

2.00 

2.22 

2.00 

21 

2.25 

2 

10 

2.22 

2.00 

3.01 

1.75 

1 

25 

2.01 

2.0500 

2.2222 

20% 

21% 

24% 

M3 

2.79 

100 

4.00 

3.00 

2.70 

2.50 

31 

3.50 

2 

76 

2.79 

2.00 

3.00 

1.75 

1 

25 

2.1250 

2.7895 

3.0000 

23% 

36% 

40% 

2A590 

3.11 

100 

5.00 

3.50 

3.11 

3.00 

31 

3.50 

2 

00 

3.00 

2.00 

3.01 

1.75 

1 

25 

2.2500 

3.0000 

31111 

25% 

40% 

42% 

Ml 

31 

100 

4.00 

3.00 

31 

3.00 

31 

3.51 

3 

00 

3.00 

3.00 

2.00 

1.75 

1 

25 

2.2500 

3.0000 

3.0000 

25% 

40% 

40% 

Ml 

2.83 

100 

4.00 

2.50 

2.83 

2.50 

31 

2 

75 

2.50 

3.00 

2.01 

1.75 

1 

25 

2,0000 

2.5000 

2.8333 

20% 

30% 

37% 

Ml 

2.21 

1.00 

3.00 

2.00 

2.21 

2.00 

21 

2.25 

2 

10 

2.21 

2.10 

1.00 

1.75 

1 

25 

1.8125 

2100 

2.2105 

16% 

20% 

24% 

MO 

3.58 

1.00 

51 

3.50 

3.58 

3.50 

41 

4.75 

3 

50 

3.51 

3.00 

5.00 

3.00 

1 

25 

3.1250 

3.5000 

3.8947 

43% 

50% 

58% 

Ml 

2.1/ 

100 

31 

2.25 

2.47 

2.00 

21 

2,47 

2 

25 

2.25 

2.00 

2.25 

1.75 

1 

26 

2,0000 

2.2500 

24178 

20% 

25% 

29% 

M2 

2.58 

100 

31 

2.50 

2.58 

2.50 

31 

2.58 

2 

50 

2.25 

3.00 

2.00 

2.25 

1 

25 

2.2510 

2.5000 

2.5789 

25% 

30% 

32% 

M3 

2.11 

1.00 

2.00 

2.50 

2.11 

2.00 

21 

2.11 

2 

00 

2.11 

2.10 

2.00 

1.75 

1 

25 

2.0000 

2.0000 

2.1053 

20% 

20% 

22% 

m 

2.32 

1.00 

21 

3.00 

2.32 

2.50 

21 

2.32 

2 

25 

2.25 

2.00 

3.01 

2.00 

1 

25 

2100 

2.2500 

2.3158 

20% 

25% 

26% 

m 

2.12 

1.00 

31 

3.50 

2.42 

2.00 

21 

2.42 

2 

25 

2.25 

3.00 

2.00 

2.75 

1 

25 

2.0000 

2.3355 

2.6678 

20% 

27% 

33% 

MS 

2.2S 

1.00 

21 

2.50 

2.26 

2.00 

21 

2.25 

2 

25 

2.26 

2.10 

2.00 

1.75 

1 

25 

2.0000 

2.0000 

2.2632 

20% 

20% 

25% 

M3 

SI 

51 

81 

51 

6.00 

6.00 

51 

6,00 

6 

00 

5.00 

61 

6.01 

6.00 

61 

6,0000 

6.0100 

6.0000 

100% 

100% 

100% 

Ml 

235 

1.00 

21 

2.50 

2.35 

2.00 

21 

2.35 

2 

25 

2.00 

2.00 

1.01 

1.50 

1.25 

1.6250 

2.0000 

2.3250 

13% 

20% 

27% 

2E1X1 

1.2S 

100 

1.00 

1.50 

1.2S 

1.50 

1.00 

1.26 

1 

25 

1.25 

1.00 

1.00 

1.26 

1.25 

1.0000 

1.2500 

1  2632 

0% 

5% 

5% 

2E2X1 

1.2S 

100 

1.00 

1.50 

1.26 

1.26 

1.00 

1.26 

1.25 

1.25 

1.00 

1.01 

1.26 

1.25 

1.0000 

1.2500 

1  2632 

1% 

5% 

5% 

21X1 

1.58 

1.00 

1.00 

1.50 

1.58 

1.50 

21 

1.58 

1.50 

1.50 

1.00 

1.00 

1.25 

1.25 

1.0625 

1.5100 

1.5592 

1% 

11% 

11% 

21X1 

1.55 

100 

21 

1.50 

1.55 

1.50 

2.00 

1.25 

1.50 

1.50 

1.00 

1.00 

1.25 

1.25 

1.2500 

1.5000 

15375 

5% 

10% 

11% 

211X1 

11 

1.00 

21 

1.50 

1.61 

1.50 

2,00 

1.25 

1.50 

1.50 

2.10 

1.01 

1.25 

1.25 

1.2500 

1.5000 

1  6000 

5% 

10% 

12% 

212X1 

1.70 

1.00 

21 

1.50 

170 

1.50 

2.00 

1.25 

1.60 

1.50 

2.00 

1.00 

1.25 

1.25 

1  2500 

1.5000 

1.7000 

5% 

11% 

14% 
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Appendix  Y :  Delphi  Survey,  Part-2  Response  for  AFSC  2A7X4 


Respondant  Number 

Quartiles 

1 

2 

3 

4 

5 

6 

7 

6 

9 

11 

11 

12 

13 

1st 

Median 

3rd 

M 

Median  1 

3rd! 

Ml 

11 

111 

2.11 

1.51 

191 

751 

2 

15 

1.95 

176 

775 

2.15 

2.51 

751 

1 

25 

51 

1 

8261 

49761 

IK 

171 

211 

Ml 

2.6S 

111 

31 

21 

255 

2.51 

3 

15 

2.25 

251 

2.75 

2.15 

2.91 

761 

1 

25 

23111 

2 

3751 

26511 

20% 

281 

331 

Ml 

1.91 

111 

2.11 

2.1 

791 

751 

2 

15 

2,51 

175 

791 

2.15 

2.91 

761 

1 

25 

5625 

1 

M 

29911 

111 

111 

211 

2A3X2 

1.91 

111 

2.11 

2.1 

791 

751 

2 

15 

2,91 

175 

791 

2.15 

2.91 

761 

1 

25 

5625 

1 

M 

2.9911 

111 

181 

211 

M3 

2.41 

111 

2.11 

2.1 

241 

21 

: 

15 

2.25 

2.25 

2.25 

2.15 

791 

751 

1 

25 

.6251 

2 

0009 

22511 

131 

211 

251 

m 

2.61 

111 

3.11 

2.51 

256 

2.51 

3 

15 

215 

2.51 

2.51 

2.15 

2.91 

751 

1 

25 

29111 

2 

5111 

26842 

211 

311 

341 

Ml 

251 

111 

2.11 

2.1 

2.51 

2.51 

2 

15 

255 

2.51 

2.25 

3.15 

2.91 

751 

1 

25 

29111 

2 

1251 

2.5911 

211 

231 

311 

M2 

2.32 

111 

2.11 

2.1 

232 

21 

2 

15 

2.25 

2.32 

2.15 

791 

751 

1 

25 

5111 

2 

0009 

2.2511 

111 

211 

251 

m 

1.95 

111 

2.11 

2.1 

795 

751 

2 

15 

1 

95 

2.11 

795 

2.15 

791 

751 

1 

25 

.5111 

1 

9511 

2.9911 

111 

191 

211 

MO 

341 

111 

4.11 

2.51 

341 

31 

: 

15 

2 

55 

3.25 

2.25 

3.15 

3.91 

3.11 

1 

25 

25251 

3 

9001 

3.3625 

331 

411 

471 

1M\ 

2.11 

111 

21 

1.75 

2.11 

21 

; 

15 

2 

15 

21 

2.11 

2.15 

751 

751 

1 

25 

.5625 

2 

0009 

21751 

111 

211 

221 

M2 

1.95 

111 

2.11 

1.75 

795 

751 

i 

15 

2 

51 

791 

795 

2.15 

791 

751 

1 

25 

.5111 

1 

9251 

79875 

111 

191 

211 

M3 

3.15 

111 

31 

3.1 

3.55 

2.51 

: 

15 

2 

51 

3.11 

3.11 

2.15 

3.91 

775 

1 

25 

21251 

3 

9119 

3.1911 

231 

411 

411 

2A6X4 

215 

111 

21 

1.75 

2.55 

2.11 

2 

15 

2 

25 

2.11 

2.15 

2.55 

2.91 

775 

1 

25 

.8125 

2 

0009 

2.1375 

161 

211 

211 

2/16X5 

2.11 

111 

2.11 

2.1 

2.11 

21 

2 

15 

2 

25 

2.11 

2.11 

2.19 

791 

775 

1 

25 

8125 

2 

9001 

2.1751 

161 

211 

221 

MS 

2.26 

111 

21 

2.1 

2.26 

21 

2 

15 

2 

26 

2.11 

2.26 

2.15 

791 

751 

1 

25 

5251 

2 

9000 

2.1974 

131 

211 

241 

2A7X3 

242 

111 

2.11 

2.51 

242 

21 

2 

15 

2 

42 

2.25 

2.25 

2.19 

791 

775 

1 

25 

8125 

2 

Jill 

2.3783 

161 

211 

281 

2A7X4 

611 

61 

5.11 

6.1 

6.51 

61 

6 

15 

6 

51 

6.11 

6.11 

6.15 

6.91 

61 

6 

19 

69111 

6 

9111 

6.1911 

1111 

1111 

1111 

2E1X1 

131 

111 

111 

1.51 

131 

151 

1 

15 

1 

31 

725 

751 

1.15 

791 

731 

1 

25 

9111 

1 

2751 

1.3911 

11 

61 

61 

m 

132 

111 

111 

155 

132 

725 

1 

15 

1 

32 

725 

751 

1.15 

791 

732 

1 

25 

91 

1 

2511 

1.3158 

11 

51 

61 

21X1 

141 

111 

111 

1.55 

741 

725 

1 

15 

1 

41 

725 

751 

1.19 

791 

125 

1 

25 

9111 

1 

2511 

44911 

11 

51 

II 

21X1 

141 

111 

2.11 

155 

146 

143 

1 

15 

43 

751 

751 

1.15 

791 

725 

1 

25 

6625 

1 

4762 

74941 

11 

111 

111 

211X1 

167 

111 

2.11 

1.55 

157 

751 

1 

15 

' 

67 

1.51 

775 

2.19 

791 

725 

1 

25 

m 

1 

5111 

16667 

51 

111 

131 

212X1 

1.52 

111 

2.11 

1.55 

752 

752 

1 

15 

1 

52 

751 

751 

1.15 

791 

725 

1 

25 

8625 

1 

5111 

75238 

11 

111 

111 

166 


Appendix  Z:  Delphi  Survey,  Part-2  Response  for  AFSC  2E1X1 


Respondant  Humber 

Quartiles 

1 

2 

3 

4 

5 

6 

7 

1 

1 

11 

11 

12 

13 

1st 

Median 

Jfi 

M 

Medians 

3fi% 

Ml 

2.11 

11 

51 

2.51 

2.11 

2.11 

2 

16 

2.25 

2.11 

1.75 

21 

2.51 

1.25 

2.0000 

2.11 

2.2511 

» 

21% 

25% 

Mi 

21 

111 

3.11 

21 

21 

21 

: 

16 

2.25 

2,11 

1.75 

21 

1.25 

1.25 

7511 

2.01 

2111 

15% 

21% 

21% 

Ml 

221 

111 

5.11 

21 

2.21 

2.11 

2 

16 

2.25 

2.11 

1.75 

21 

2.11 

1.26 

2.0000 

2.01 

2.2115 

21% 

21% 

24% 

Ml 

221 

1.11 

5.11 

21 

2.21 

21 

2 

16 

2.25 

2.11 

1.75 

21 

21 

1.25 

2.61 

2.01 

2.2115 

21% 

21% 

24% 

2A3X3 

11 

111 

31 

175 

11 

1.51 

: 

16 

1.56 

161 

1.75 

21 

1.75 

1.25 

.5111 

46642 

17511 

11% 

14% 

15% 

2A590 

21 

111 

4.11 

21 

21 

1.51 

2 

16 

2.25 

21 

1.75 

21 

1.25 

1 

25 

.51 

2.01 

2.0556 

11% 

21% 

21% 

Ml 

1.74 

111 

3.11 

175 

174 

1.51 

2 

16 

1.56 

1.75 

1.75 

21 

1.74 

1 

25 

.51 

1.7366 

17511 

11% 

15% 

15% 

2A5X2 

111 

111 

31 

1.51 

1.61 

1.51 

: 

16 

161 

1.75 

21 

1.75 

1 

25 

.51 

1.6111 

48125 

11% 

12% 

16% 

m 

221 

1.11 

41 

21 

2.21 

2.11 

2 

16 

2.25 

2.11 

2.11 

21 

2.51 

25 

2.0000 

2.01 

2.2115 

21% 

21% 

24% 

Ml 

1.55 

111 

4.11 

1.51 

115 

1.51 

2 

16 

3.56 

111 

2.11 

31 

1.75 

1 

25 

.51 

1.1474 

2.01 

11% 

13% 

21% 

Ml 

1.42 

111 

2.11 

1.56 

1.42 

1.25 

1 

16 

1.56 

135 

1.51 

21 

1.61 

1.25 

1 

26 

.2511 

1.3655 

15011 

5% 

6% 

11% 

Mil 

1.47 

111 

2.11 

1.51 

1.47 

1.25 

1 

16 

1.56 

1 

41 

1.51 

21 

1.51 

1 

25 

.2511 

1.4737 

15611 

5% 

3% 

11% 

Ml] 

1.47 

111 

21 

1.51 

1.47 

1.25 

1 

16 

1.47 

1 

41 

1.51 

21 

1.25 

1 

25 

.2511 

44737 

111 

5% 

3% 

11% 

Ml 

1.47 

111 

2.11 

1.51 

1.47 

1.25 

1 

16 

147 

1 

41 

1.51 

21 

1.25 

1 

25 

.2511 

1.4737 

111 

5% 

3% 

11% 

1X5 

1.47 

III 

21 

1.56 

1.47 

1.25 

1 

16 

1.47 

1 

41 

1.51 

21 

1.61 

1.25 

1 

25 

.2511 

1.4366 

1.4334 

5% 

3% 

11% 

MS 

21 

111 

41 

21 

21 

21 

2 

16 

2.66 

2 

61 

1.75 

31 

21 

1 

25 

2.0000 

2.01 

2.0011 

21% 

21% 

21% 

2A7X3 

1.47 

111 

2.11 

1.56 

1.47 

1.25 

1 

16 

1,47 

1 

41 

1.51 

21 

1.61 

1.25 

1 

25 

.2511 

1.4366 

14334 

5% 

3% 

11% 

Ml 

1.37 

III 

2.11 

1.56 

1.37 

1.25 

1 

16 

1.37 

1 

31 

1.51 

21 

1.61 

1.25 

1 

25 

.2511 

1.3342 

1.4671 

5% 

7% 

3% 

2E1X1 

51 

61 

111 

SI 

61 

6.00 

5 

16 

6,66 

6 

61 

6.00 

61 

6.61 

61 

6 

II 

5.0000 

6.61 

6.01 

111% 

111% 

111% 

m 

31 

2.11 

4.11 

4.66 

311 

3.51 

4 

16 

475 

3 

51 

3.51 

31 

3.61 

4.25 

1 

25 

3.1250 

3.5511 

4  0611 

43% 

51% 

51% 

21X1 

11 

2.11 

21 

1.56 

155 

1.51 

2 

16 

1.51 

1 

61 

1.51 

11 

2.61 

1.75 

1 

25 

.51 

1.5251 

11375 

11% 

13% 

13% 

21X1 

121 

111 

21 

1.25 

1.21 

1.25 

1 

16 

1.25 

1 

21 

1.25 

11 

1.61 

1.25 

1 

25 

.1511 

1.2251 

12511 

1% 

5% 

5% 

211X1 

121 

111 

2.11 

1.25 

1.21 

1.25 

1 

16 

1.25 

1.21 

1.26 

11 

1.61 

1.25 

1 

25 

.1511 

1.2251 

12511 

1% 

5% 

5% 

212X1 

1.35 

III 

2.11 

1.25 

1.35 

1.25 

1 

16 

1.25 

1.31 

1.51 

11 

1.61 

1.25 

1 

25 

.6625 

1.2511 

1.3375 

1% 

5% 

7% 

167 


Appendix  AA:  Delphi  Survey,  Part-2  Response  for  AFSC  2E2X1 


Respondant  Number 

Quartiles 

1 

2 

3 

4 

5 

6 

7 

8 

8 

11 

11 

12 

13 

Is! 

Median 

3rd 

1st! 

Median  % 

3rd* 

Ml 

2.15 

111 

51 

2.55 

2.15 

21 

2 

15 

2,55 

2.51 

2.25 

21 

2.51 

1 

25 

2,51 

26526 

22511 

20% 

21* 

25* 

Ml 

1.51 

111 

31 

2.55 

1.68 

1.51 

2 

II 

2.25 

1.61 

21 

2.15 

1.25 

1 

25 

.5115 

1.6842 

261 

11* 

14* 

25* 

2A3X1 

2.51 

111 

11 

2.15 

21 

21 

2 

II 

2.25 

2.11 

21 

21 

21 

1 

25 

2,51 

25115 

261 

21* 

21* 

25* 

2A3X2 

2.51 

111 

11 

2.15 

2.51 

21 

2 

II 

2.25 

21 

21 

21 

21 

1 

25 

211 

2.5111 

261 

21* 

21* 

25% 

M3 

1.53 

111 

21 

1.75 

1.63 

1.51 

2 

15 

1,63 

1.61 

1.75 

21 

1.63 

1 

25 

.6511 

16316 

17511 

12* 

13% 

15* 

2A1 

1.53 

111 

31 

2.11 

1.63 

1.51 

2 

15 

1.63 

1.61 

1.75 

21 

1.63 

1 

25 

.6511 

1.5316 

261 

12* 

13* 

25* 

2A5X1 

1.51 

111 

21 

1.75 

1.61 

1.51 

2 

15 

1,61 

161 

1.75 

21 

1.61 

1 

25 

111 

16111 

17511 

12* 

12% 

15* 

2A5X2 

1.55 

111 

21 

1.55 

1.58 

1.51 

2 

15 

1.61 

1.75 

21 

1.58 

1 

25 

.5511 

1.5788 

1.8125 

11* 

12* 

16* 

2A5X3 

2.55 

111 

41 

2.11 

2.15 

21 

2 

15 

2.55 

21 

21 

21 

2.25 

1 

25 

2.1000 

26511 

2  6526 

21* 

25* 

21* 

Mi 

1.63 

111 

21 

1.51 

1.63 

1.51 

2 

15 

2.25 

1.61 

1.75 

31 

1.63 

1 

25 

.5511 

1.5316 

261 

11* 

13* 

21* 

Ml 

1.37 

111 

1.11 

1.51 

137 

1.25 

1 

15 

1.25 

1.25 

1.51 

21 

1.55 

1.37 

1 

25 

8525 

1.2511 

13684 

1* 

5% 

7* 

Mil 

1.37 

1.51 

1.11 

1.55 

137 

1.25 

1 

15 

1.25 

1.25 

1.51 

21 

1.37 

1 

25 

.2515 

1.2511 

13684 

5* 

5* 

7* 

M3 

1.33 

111 

11 

1.51 

133 

1.25 

1 

15 

1.25 

1.25 

1.51 

21 

1.33 

1 

25 

.2511 

1.2511 

13333 

5* 

5* 

7* 

Ml 

1.37 

1.51 

1.11 

1.51 

137 

1.25 

1 

15 

1.25 

1.31 

1.51 

21 

1.37 

1 

25 

.2515 

131 

13684 

5* 

6* 

7* 

2A6X5 

147 

HI 

1.11 

1.51 

1.47 

1.25 

1 

15 

1.25 

1.41 

1.51 

21 

1.11 

1.47 

1 

25 

.1525 

13251 

1.4737 

1* 

7* 

8% 

Ml 

1.81 

111 

31 

2.11 

1.34 

21 

2 

15 

2.51 

1.75 

21 

31 

1.84 

1 

25 

.8421 

2.51 

261 

17* 

25* 

25* 

2A7X3 

1.32 

111 

11 

1.51 

132 

1.25 

1 

15 

1.25 

1.25 

1.51 

2.11 

1.55 

1.32 

1 

25 

.1625 

1.2511 

13158 

11 

5* 

6% 

MIX! 

132 

1.11 

1.51 

132 

1.25 

1 

15 

1.25 

1.25 

1.51 

2.11 

1.11 

1.32 

1 

25 

.2515 

1.2511 

13158 

5* 

5% 

6* 

2E1X1 

3.17 

111 

51 

4.55 

3.47 

31 

3 

15 

4.75 

3.25 

3.25 

41 

4.11 

3.75 

1 

25 

3.5625 

3.4737 

461 

41* 

48* 

65* 

m 

6.51 

61 

61 

6.55 

61 

61 

6 

15 

6.55  |  6.51 

61 

61 

61 

6 

II 

6,51 

661 

651 

111* 

111* 

111* 

21X1 

1.51 

211 

1.11 

1.55 

1.51 

1.51 

1 

15 

1.55 

1.51 

1.51 

11 

2.11 

1.75 

1 

25 

3125 

151 

1.5551 

61 

15* 

15* 

21X1 

133 

111 

1.25 

133 

1.25 

1 

15 

1.25 

1.25 

1.51 

11 

1.11 

1.25 

1 

25 

15 

1.2511 

12511 

5* 

5% 

5* 

211X1 

135 

111 

21 

1.25 

131 

1.25 

1 

II 

1.25 

1.25 

1.51 

11 

1.11 

1.25 

1 

25 

,5625 

1.2511 

1  2875 

1% 

5* 

6* 

212X1 

1.45 

111 

21 

1.25 

111 

1.25 

1 

II 

1.25 

1,41 

1.51 

11 

1.11 

1.25 

1 

25 

6625 

1.2511 

141 

1* 

5* 

8% 

168 


Appendix  AB:  Delphi  Survey,  Part-2  Response  for  AFSC  2M0X1 


Respondant  Number 

Quaitiles 

1 

2 

3 

4 

5 

6 

7 

1 

3 

11 

11 

12 

13 

tii 

Median 

3rd 

Istl 

Median  % 

Ml 

Ml 

163 

1.1 

2.11 

241 

143 

2.11 

241 

143 

141 

1.75 

21 

3.51 

1.63 

1 

25 

4316 

14318 

2.5111 

131 

14% 

21% 

Mi 

179 

1.1 

4.11 

2.11 

1.73 

1.51 

241 

1,73 

175 

1.75 

21 

2.51 

1.73 

i 

25 

.7615 

1.7835 

2.5111 

15% 

16% 

21% 

Ml 

163 

11 

2.11 

165 

1.53 

1.51 

2.11 

143 

141 

1.75 

241 

1.75 

1.53 

25 

.5166 

1.5263 

17511 

11% 

11% 

15% 

Ml 

163 

1.1 

2.11 

165 

1.53 

1.51 

2 

11 

143 

141 

1.75 

21 

1.55 

1.53 

1 

25 

.5166 

1.5263 

1.7125 

11% 

11% 

14% 

M3 

1.32 

1.1 

2.11 

165 

1.37 

1.25 

1 

11 

1.37 

1.31 

1.75 

21 

1.51 

1.37 

1 

25 

.2615 

1  3684 

1.4671 

5% 

7% 

3% 

2A590 

1.72 

1.1 

4.11 

165 

1.72 

1.51 

2 

11 

1.72 

141 

1.75 

21 

1.51 

1.72 

1 

25 

4115 

1.7222 

1.7431 

11% 

14% 

15% 

Ml 

1.12 

141 

2.11 

165 

1.42 

1.25 

1 

11 

142 

135 

1.75 

241 

1.51 

1.42 

1 

25 

.2511 

1.4211 

1.4813 

5% 

8% 

11% 

Ml 

1.42 

141 

2.11 

165 

1.42 

1.25 

1 

11 

1,41 

1.75 

245 

1.51 

1.42 

1 

25 

.2515 

1.4211 

14511 

5% 

8% 

11% 

Ml 

1.47 

1.11 

2.11 

165 

1.47 

1.51 

1 

11 

147 

141 

1.51 

245 

2.51 

1.47 

25 

.4184 

1.4737 

14111 

8% 

3% 

11% 

Ml 

1.74 

111 

4.11 

265 

1.74 

1.51 

2 

11 

1.74 

1.75 

1.75 

31 

2.51 

1.74 

1 

25 

.7368 

1.7434 

2.5111 

15% 

15% 

21% 

2A6X1 

1.37 

141 

2.11 

161 

1.37 

1.25 

1 

11 

1.37 

135 

1.51 

21 

1.51 

1.37 

1 

26 

2615 

1.3684 

1  4571 

5% 

7% 

3% 

Mil 

1.42 

1.11 

2.11 

2.51 

142 

1.25 

1 

11 

1.42 

1.35 

1.51 

21 

1.51 

1.42 

1 

25 

2515 

1.4211 

14313 

5% 

8% 

11% 

Ml] 

1.37 

141 

2.11 

1.25 

1.37 

1.25 

1 

11 

1.37 

135 

1.51 

241 

1.51 

1.37 

1 

25 

2515 

1.3532 

1  3684 

5% 

7% 

7% 

im 

1.37 

141 

2.11 

2.11 

1.37 

1.25 

1 

11 

137 

1.35 

1.51 

21 

2.51 

1.37 

1 

25 

.2751 

1.3684 

1  5751 

6% 

7% 

13% 

Ml 5 

137 

141 

2.11 

2.11 

1.37 

1.25 

1 

11 

137 

1.35 

1.51 

21 

1.51 

1.37 

1 

25 

2515 

1.3584 

1.4571 

5% 

7% 

3% 

MS 

147 

1.11 

265 

1.47 

1.51 

1 

11 

1.47 

1.41 

1.51 

21 

2.51 

1.47 

1 

25 

4115 

1.4716 

1.5511 

8% 

3% 

11% 

m 

137 

141 

2.11 

2.15 

1.37 

1.25 

1 

11 

1.37 

135 

1.51 

245 

1.51 

1.37 

1 

26 

2515 

1  3684 

1.4571 

5% 

7% 

3% 

Ml 

122 

141 

2.11 

1.25 

1.22 

1.25 

1 

11 

122 

1.21 

1.51 

2.15 

151 

1.22 

1 

25 

2156 

1.2222 

12511 

4% 

4% 

5% 

11X1 

1.37 

141 

2.11 

1.55 

1.37 

1.25 

1 

11 

1.37 

1.31 

1.51 

145 

2.51 

1.37 

1 

25 

2511 

1  3684 

1.4671 

5% 

7% 

3% 

m 

1.3S 

141 

165 

1.35 

1.25 

1 

11 

1.35 

1.25 

1.51 

145 

2.51 

1.35 

1.25 

2515 

1.3523 

1.3523 

5% 

7% 

7% 

21X1 

6.11 

641 

641 

6.11 

6.11 

6.11 

5 

11 

6.11 

641 

6.11 

645 

6.00  |  6.01 

6.15 

6.5115 

6.5015 

6.5111 

111% 

111% 

111% 

21X1 

166 

1.11 

2.11 

165 

2.25 

1.51 

2 

11 

1.55 

1.51 

1.51 

145 

2.51 

2.25 

1.25 

.51 

1.5251 

25111 

11% 

11% 

21% 

211X1 

141 

141 

2.11 

165 

141 

1.51 

2 

11 

141 

151 

1.51 

145 

3.51 

1.51 

1.26 

.51 

1.51 

14511 

11% 

11% 

12% 

212X1 

1.76 

1.11 

2.11 

165 

175 

1.51 

2 

11 

1.75 

1.75 

1.75 

11 

2.51 

2.25 

1.25 

41 

1.7511 

1.3375 

11% 

15% 

13% 

169 


Appendix  AC:  Delphi  Survey,  Part-2  Response  for  AFSC  2W0X1 


Respondant  Number 

Quartiles 

1 

2 

3 

4 

5 

5 

7 

1 

3 

11 

11 

12 

13 

1st 

Median 

3rd 

M 

Median  1 

3rd% 

Ml 

IIS 

111 

21 

2.1 

1.75 

1.5! 

2 

1! 

1.75 

1 

61 

1.51 

21 

3.51 

1.51 

1 

25 

.51 

171 

2.0600 

10% 

15% 

20% 

Ml 

21 

111 

31 

21 

21 

21 

2 

15 

2,51 

2 

II 

3.51 

21 

2.51 

1.75 

1 

25 

2.0000 

2.51 

2.5011 

20% 

20% 

20% 

2A3X1 

1.51 

111 

21 

1.51 

1.51 

1.51 

2 

15 

1.51 

1 

51 

21 

21 

2.51 

1.51 

1 

25 

51 

1.51 

2.5500 

10% 

10% 

20% 

2A3X2 

1.55 

111 

21 

1.51 

1.55 

1.51 

: 

15 

1.55 

1 

5! 

21 

21 

2.51 

1.51 

1 

25 

,51 

1.5511 

2.5011 

10% 

11% 

20% 

M3 

11 

111 

21 

1.51 

1.51 

1.51 

2 

1! 

1,61 

1 

61 

21 

21 

1.51 

1.51 

1 

25 

.51 

161 

111 

10% 

12% 

18% 

2A590 

135 

111 

31 

2.1 

135 

1.51 

2 

1! 

135 

2 

1! 

21 

21 

11 

1.75 

1 

25 

.5625 

13474 

2.0600 

11% 

13% 

20% 

2A5X1 

1.55 

111 

21 

1.51 

1.55 

1.51 

2 

1! 

1,55 

1 

51 

21 

21 

11 

1.51 

1 

25 

51 

1.5251 

1.8875 

10% 

11% 

18% 

Ml 

1.53 

111 

21 

1.51 

1.53 

1.51 

2 

1! 

1 

51 

1.75 

21 

1.61 

1.51 

1 

25 

.51 

1.51 

17511 

10% 

10% 

15% 

Ml 

1.53 

111 

21 

1.75 

1.53 

1.51 

2 

1! 

1.53 

1 

51 

1.75 

21 

1.51 

1.51 

1 

25 

.51 

1.5263 

17511 

10% 

11% 

15% 

Mi 

21 

111 

41 

2.1 

2.51 

21 

2 

1! 

21 

2 

II 

21 

31 

11 

2.25 

1 

25 

2.0000 

2.51 

2.6600 

20% 

20% 

20% 

1M\ 

1.15 

111 

21 

1.51 

1.15 

1.25 

1 

15 

1.45 

1 

41 

1.75 

21 

11 

1.51 

1 

25 

.2511 

1.451! 

1.51 

5% 

3% 

10% 

Mil 

115 

11 

21 

3.1 

1.45 

1.51 

1 

1! 

1.45 

1 

4! 

1.75 

21 

11 

2.25 

1 

25 

.2875 

1.4511 

13375 

6% 

3% 

13% 

Mil 

1.51 

1.1! 

21 

1.51 

1.5! 

1.51 

1 

1! 

1.51 

1 

51 

1.75 

21 

11 

2.75 

1 

25 

.3125 

1.51 

1.6875 

6% 

10% 

14% 

Mi 

115 

1.1! 

21 

1.5! 

1.45 

1.25 

1 

1! 

1.45 

1 

4! 

1.75 

21 

1.51 

1.51 

1 

25 

.2511 

1.4511 

1.51 

5% 

8% 

10% 

Mi 

112 

21 

1.5! 

1.42 

1.25 

1 

1! 

1.42 

1 

4! 

1.75 

2.16 

1.51 

1.51 

1 

25 

.2511 

14211 

1.51 

5% 

8% 

10% 

MIX! 

1.51 

1.1! 

21 

2.5! 

1.5! 

1.51 

2 

1! 

1.55 

1 

5! 

1.75 

2.15 

1.25 

1 

25 

.51 

1.5000 

2.5011 

10% 

10% 

20% 

M7X3 

115 

1.1! 

21 

2.1 

145 

1.25 

1 

1! 

1.45 

1 

4! 

1.75 

21 

1.51 

1.75 

1 

25 

.2511 

1.451! 

17511 

5% 

8% 

15% 

Mi 

1.15 

Ill 

21 

1.55 

1.45 

1.25 

1 

1! 

1.45 

1 

4! 

1.51 

2.16 

1.5! 

1.25 

1 

25 

.2511 

1.4251 

74875 

5% 

3% 

10% 

2E1X1 

1.37 

1.1! 

21 

1.25 

1.37 

1.25 

1 

1! 

1.37 

' 

25 

1.51 

11 

11 

1.25 

1 

25 

.1625 

1.2511 

1.3684 

1% 

5% 

7% 

2E2X1 

1.35 

21 

1.25 

1.35 

1.25 

1 

1! 

1.35 

' 

25 

1.51 

1.15 

11 

1.25 

1 

25 

.2511 

1.2511 

1.3528 

5% 

5% 

7% 

21X1 

1.35 

11 

11 

1.25 

135 

1.51 

2 

1! 

135 

2 

1! 

1.75 

1.15 

1.5! 

151 

1 

25 

.1625 

1.5000 

1.3474 

1% 

10% 

13% 

21X1 

6.00 

5.1! 

51 

5.1 

5.50 

61 

5 

1! 

6,51 

6 

1! 

6.00 

61 

6.11 

6.11 

6 

1! 

6,11 

6.01 

6.6600 

100% 

100% 

100% 

211X1 

3.3S 

2.5! 

31 

4.55 

3.31 

31 

3 

1! 

4,75 

3 

25 

3.75 

41 

3.5! 

4.11 

1 

25 

3,51 

3.3155 

33375 

40% 

46% 

53% 

212X1 

3.41 

21 

51 

4.55 

3.41 

31 

4 

1! 

4,75 

3 

51 

3.51 

41 

3.51 

3.41 

1 

25 

3,11 

3.4881 

4100 

42% 

50% 

60% 

170 


Appendix  AD:  Delphi  Survey,  Part-2  Response  for  AFSC  2W1X1 


Respondant  Number 

Quartiles 

1 

2 

3 

4 

5 

6 

7 

8 

8 

11 

11 

12 

13 

Is! 

Median 

3rd 

M 

Median  H 

3(d% 

Ml 

1.31 

111 

31 

1.75 

131 

1.51 

2 

11 

130 

175 

1.75 

21 

3.11 

181 

1 

25 

.7511 

1 

81 

13751 

15% 

18% 

21% 

Ml 

2.51 

111 

31 

2.11 

3.11 

2.51 

3 

11 

2.51 

2.51 

3.51 

2.11 

3.11 

3.11 

1 

25 

2.1251 

2 

51 

3.1111 

23% 

31% 

41% 

Ml 

11 

111 

31 

2.11 

181 

1.51 

2 

II 

1.81 

475 

2.25 

2.11 

2.11 

2.51 

1 

25 

.7625 

1 

91 

2.1111 

15% 

18% 

21% 

M2 

11 

111 

31 

2.11 

1.85 

1.51 

2 

II 

1,85 

175 

21 

21 

2.11 

2.51 

1 

25 

7751 

1 

9251 

2.1111 

16% 

19% 

21% 

Ml 

2.15 

111 

2.11 

2.11 

3.11 

21 

: 

II 

2,15 

2,11 

2.25 

2.11 

2.11 

2.75 

1 

25 

2.0000 

2 

0001 

21511 

21% 

21% 

21% 

2A590 

2.12 

111 

2.11 

251 

3.11 

2.11 

2 

II 

2,42 

2.25 

2.51 

21 

2.11 

2.75 

1 

25 

2.1111 

2 

1251 

24813 

21% 

23% 

31% 

2A5X1 

135 

111 

2.11 

2.11 

3.11 

1.51 

2 

11 

135 

2,11 

135 

2.11 

2.11 

2.25 

1 

25 

8511 

2 

0001 

2.1111 

19% 

21% 

21% 

M2 

11 

111 

2.11 

151 

3.11 

1.51 

2 

11 

475 

1.88 

2.11 

1.11 

2.25 

1 

25 

.5111 

1 

8947 

2.1111 

11% 

18% 

21% 

M3 

1.75 

111 

3.11 

2.11 

1.75 

1.51 

2 

11 

1.75 

1.75 

1.85 

2.11 

411 

1.75 

1 

25 

.5625 

1 

7511 

18625 

11% 

15% 

19% 

Ml 

2.16 

11 

3.11 

251 

3.11 

21 

1 

11 

2.45 

2.25 

2.25 

3.15 

2.11 

2.51 

1 

25 

2.1111 

2 

3511 

25111 

21% 

27% 

31% 

Ml 

11 

111 

111 

151 

151 

1.51 

2 

11 

1.61 

1.55 

1.75 

2.11 

1.11 

1.51 

1 

25 

.3125 

1 

5251 

1.6111 

6% 

11% 

12% 

M2 

151 

1.11 

111 

251 

1.51 

1.51 

2 

11 

1.51 

1.51 

1.75 

2.15 

2.11 

3.11 

1 

25 

.5111 

1 

5111 

2.1111 

11% 

11% 

21% 

M3 

151 

111 

111 

151 

1.51 

1.51 

2 

11 

1.51 

1.51 

1.75 

2.16 

2.11 

2.25 

1 

25 

.5111 

1 

5111 

18375 

11% 

11% 

19% 

Ml 

151 

11 

111 

2.11 

1.51 

1.51 

2 

11 

151 

451 

1.75 

2.11 

1.11 

1.75 

1 

25 

.3125 

1 

5111 

1.7511 

6% 

11% 

15% 

2/161(5 

155 

111 

2.11 

151 

155 

1.51 

2 

11 

1.65 

161 

1.75 

2.11 

411 

1.75 

1 

25 

.5111 

1 

6511 

17511 

11% 

13% 

15% 

MS 

111 

11 

3.11 

251 

1.74 

1.51 

2 

11 

1.74 

475 

1.75 

2.15 

2.11 

2.25 

1 

25 

.7368 

1 

7511 

2.1111 

15% 

15% 

21% 

M3 

151 

111 

2.11 

2.11 

1.51 

1.51 

1 

11 

1.51 

1.51 

1.51 

2.11 

ill 

21 

1 

25 

.3125 

1 

5111 

1.8751 

6% 

11% 

18% 

Ml 

1.37 

111 

111 

151 

1.37 

1.25 

1 

11 

1.37 

1.25 

1.51 

2.11 

1.11 

1.25 

1 

25 

.1625 

1 

2511 

1.3684 

1% 

5% 

7% 

2E1X1 

1.21 

111 

111 

1.25 

1.21 

1.25 

1 

11 

1.21 

1.25 

1.25 

1.11 

1.11 

1.25 

1 

25 

111 

1 

2115 

12511 

1% 

4% 

5% 

2E2X1 

1.21 

111 

111 

1.25 

1.21 

1.25 

1 

11 

1.21 

1.25 

1.25 

1.11 

1.11 

1.25 

1 

25 

.11 

1 

2115 

12511 

1% 

4% 

5% 

21X1 

153 

111 

111 

1.25 

153 

1.51 

2 

11 

1.63 

161 

1.51 

1.11 

ill 

1.25 

1 

25 

.1625 

1 

3751 

1.6237 

1% 

8% 

12% 

21X1 

3.1 

111 

(11 

4.11 

3.85 

3.51 

4 

II 

4.75 

3.75 

4.25 

111 

4.11 

411 

1 

25 

3.5625 

3 

9251 

4.1111 

51% 

59% 

61% 

211X1 

6.11 

6.11 

6.11 

6.11 

6.11 

6.11 

6 

11 

6,11 

6.11 

61 

6.11 

6.11 

6.11 

6 

11 

5,1111 

6 

1111 

61111 

111% 

111% 

111% 

212X1 

3.71 

21 

1.11 

4.11 

3.71 

3.51 

4 

II 

4,75 

3.71 

3.75 

41 

3.11 

3.25 

1 

25 

3.3125 

3 

7143 

41111 

46% 

54% 

61% 

171 


Appendix  AE:  Delphi  Survey,  Part-2  Response  for  AFSC  2W2X1 


Respondant  Number 

Quantiles 

1 

2 

3 

4 

5 

6 

7 

1 

9 

11 

11 

12 

13 

14 

1st 

Median 

3rd 

IstI 

Median  1 

Ml 

Ml 

1.90 

1.11 

3.11 

11 

1.91 

1.51 

21 

1.91 

1.75 

1.75 

21 

1.51 

1.25 

1 

25 

1.5111 

1.8251 

111 

1 

171 

181 

Ml 

2.11 

111 

3.11 

2.51 

2.11 

2.11 

2,11 

2.11 

2,11 

2.11 

21 

21 

1.25 

1 

25 

2.1111 

2.11 

21111 

20% 

211 

221 

Ml 

11 

111 

3.11 

2.11 

161 

1.51 

21 

161 

1.51 

1.75 

21 

31 

1.25 

25 

1.5251 

1.61 

2111 

111 

121 

211 

Ml 

11 

1.11 

3.11 

2.11 

1.65 

1.51 

2 

11 

165 

1.61 

1.75 

21 

31 

1.25 

1 

25 

1.5251 

1.6511 

211 

111 

131 

211 

M3 

1.70 

111 

2.11 

2.11 

1.71 

1.51 

2 

11 

1,71 

171 

1.75 

21 

111 

1.25 

1 

25 

1.3125 

1.71 

1.9375 

61 

141 

191 

2A590 

2.11 

111 

3.11 

2.55 

2.11 

2.11 

11 

2.11 

2.11 

2.11 

21 

11 

1.25 

1 

25 

1.4375 

2 

II 

2.1053 

91 

211 

221 

Ml 

11 

111 

2.11 

166 

1.51 

2 

11 

166 

1.61 

1.75 

21 

111 

1.25 

1 

25 

1.2511 

1 

5842 

1.7511 

51 

141 

151 

2A5X2 

11 

111 

2.11 

1.75 

166 

1.51 

: 

11 

161 

1.75 

21 

11 

1.25 

1 

25 

1.2611 

1 

684! 

17511 

51 

141 

151 

Ml 

11 

1.11 

3.11 

2.11 

1.65 

1.51 

2 

11 

1.65 

1.51 

1.51 

21 

21 

1.25 

1 

25 

1.5000 

1 

8500 

2.1111 

111 

131 

211 

Ml 

2.1S 

1.11 

3.11 

2.11 

2.15 

2.11 

2 

11 

2.25 

2.11 

2.11 

31 

21 

1.25 

1 

25 

211 

2 

1001 

21511 

211 

211 

231 

Ml 

1.51 

111 

111 

1.55 

1.51 

1.51 

: 

11 

1.51 

151 

1.51 

21 

111 

1.25 

1 

26 

1.2511 

1 

51 

15111 

51 

111 

111 

M2 

1.47 

111 

1.55 

1.47 

1.47 

1 

11 

1.51 

1.41 

1.51 

21 

ill 

2.11 

1 

25 

1.2511 

1 

4737 

111 

51 

91 

111 

Ml] 

11 

111 

111 

1.55 

1.51 

1.51 

1 

11 

1.51 

1.51 

1.51 

21 

ill 

1.25 

1 

25 

1125 

1 

51 

111 

11 

111 

111 

M4 

1.45 

111 

111 

1.51 

1.45 

1.25 

i 

11 

1.51 

1.41 

1.51 

21 

ill 

1.25 

1 

25 

1.0625 

1 

3251 

1  4875 

11 

71 

111 

1X5 

1.55 

1.11 

2.11 

2.11 

1.55 

1.51 

2 

11 

1.51 

1.51 

1.51 

21 

ill 

1.25 

1 

25 

1.3125 

1 

51 

1.8875 

61 

111 

181 

MS 

1.1 

1.11 

3.11 

2.55 

1.55 

1.51 

2 

11 

1.51 

1.61 

1.51 

21 

21 

1.25 

1 

25 

1.5000 

1 

6251 

2.1111 

111 

131 

211 

1X3 

1.51 

111 

2.11 

1.55 

1.51 

1.51 

2 

11 

1.51 

151 

1.51 

21 

111 

1.25 

1 

26 

13125 

1 

51 

15111 

61 

111 

111 

1X4 

1.41 

1.11 

111 

1.55 

141 

1.25 

1 

11 

1.51 

1.41 

1.51 

21 

ill 

1.25 

1 

25 

1.0625 

1 

3251 

14751 

11 

71 

111 

2E1X1 

1.32 

111 

2.11 

1.55 

132 

1.25 

1 

11 

1.32 

1.25 

1.25 

11 

ill 

1.25 

1 

25 

1.1625 

1 

2511 

1.3158 

11 

51 

61 

2E1X1 

132 

111 

2.11 

1.55 

132 

1.25 

1 

11 

1.32 

1.25 

1.25 

11 

ill 

1.25 

1.25 

1.1625 

1.2511 

1.315! 

11 

51 

61 

11X1 

1.19 

11 

111 

2.55 

1.19 

1.51 

2 

11 

1.89 

1.91 

1.89 

11 

21 

2.25 

1.25 

1.3125 

1.8947 

1.9751 

61 

111 

211 

21X1 

3.41 

111 

5.11 

3.51 

3.41 

3.11 

3 

11 

4.75 

3.41 

3.75 

11 

21 

ill 

1.25 

2.2511 

3.41 

3  6875 

251 

481 

541 

1X1 

3.51 

111 

4.11 

3.55 

3.51 

3.11 

31 

4.75 

3.25 

4.25 

41 

4.11 

2.51 

1.25 

3.1110 

3.5111 

4111 

411 

511 

611 

21X1 

6.11 

61 

6.01 

6.11 

6.11 

6.11 

51 

6.11 

6.11 

6.11 

61 

61 

6.11 

6.11 

6.0000 

6.1001 

6.11 

1111 

1111 

1111 

172 


Appendix  AF:  Abort  Rate  and  MX/Ops  Deviation  Count  Correlations 
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Appendix  AG:  MC  and  TNMCM  Rate  Correlations 
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Appendix  AH:  Break  and  Fix  Rate  Correlations 
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Appendix  AI:  Cannibalization  Rate  Correlations 


Metric  |  Lag  0  |  Lag  1 1  Lag  2 

Lag  3 

Lag  4 

Beale 

CANN  (U-2)  |  0.031  -0.085 

0.231 

0.284 

0.439 

Cannon 

CANN  (F- 16/30) 

0.191 

0.239 

0.350 

0.457 

0.377 

CANN  (F-16  40) 

0.647 

0.567 

0.515 

0.451 

0.157 

CANN  (F- 16' 50) 

-0.315 

-0.413 

-0.522 

-0.526 

-0.707 

CANN  (F-16  52) 

-0.066 

-0.129 

-0.116 

-0.022 

0.060 

Davis-Monthan 

CANN  (A- 10  Op) 

0.357 

0.077 

-0.010 

-0.391 

-0.345 

CANN  (A- 10  Tra) 

-0.038 

0.006 

-0.432 

-0.486 

-0.287 

Dyess 

CANN  (B-52) 

0.263  -0.471 

-0.445  -0.521  -0.452 

Ellsworth 

CANN  (B-l) 

0.540  0.598  0.540  0.421  0.670 

Langley 

CANN  (F-15C  D)  |  0.488 

-0.118  0.183  0.496  0.357 

Minot 

CANN  (B-52)  1-0.578  -0.632 

-0.643 

-0.567 

-0.353 

Mountain  Home 

CANN  (F-15C) 

0.202 

0.145 

0.057 

-0.131 

-0.609 

CANN  (F-15E) 

-0.114 

-0.443 

-0.368 

-0.206 

-0.141 

CANN  (F- 16/50) 

0.109 

-0.102 

-0.287 

-0.319 

-0.190 

Nellis 

CANN  (A- 10) 

0.601 

0.459 

0.494 

0.480 

0.444 

CANN  (F-15E) 

0.761 

0.698 

0.600 

0.646 

0.584 

CANN  (F-15C  D) 

0.112 

0.250 

0.132 

0.105 

-0.050 

CANN  (F-16  30) 

-0.115 

-0.167 

-0.151 

-0.160 

-0.002 

CANN  (F-16  40) 

-0.395 

-0.486 

-0.513 

-0.447 

-0.551 

CANN  (F-16  50) 

-0.183 

-0.119 

-0.085 

0.015 

-0.056 

Offutt 

CANN  (E-4B) 

-0.134 

-0.059 

-0.170 

-0.211 

-0.233 

CANN  (RC- 13  5) 

-0.314 

-0.201 

-0.159 

-0.195 

-0.132 

Pope 

CANN  (A- 10) 

0.278 

0.360 

-0.104 

-0.388 

-0.192 

Seymour- Johnson 

CANN  (F-15E  Op) 

0.139 

0.281 

0.505 

0.559 

0.370 

CANN  (F-15E  Tm) 

-0.493 

-0.606 

-0.675 

-0.652 

-0.498 

Shaw 

CANN  (F-16' 50) 

-0.411 

-0.378 

-0.325  -0.365  -0.379 

Whiteman 

CANN  (B-2A) 

-0.561  -0.667 

-0.707 

-0.755 

-0.551 
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Appendix  AJ:  Dropped  Objects  and  Foreign  Object  Damage  Count  Correlations 
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Appendix  AK:  Deficiency  Report  and  TO  Improvement  Submitted  Correlations 
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Appendix  AL:  Safety  and  Technical  Violation  Count  Correlations 


Metric  |  Lag  0 

Lag  1 

Lag  2 

Lag  3 

Lag  4 

Beale 

STV  1-0.039 

0.100 

-0.179 

-0.217 

-0.308 

Cannon 

STV  |  0.057 

0.142 

0.210 

0.287 

0.420 

Davis-Monthan 

STV  1-0.067 

0.155 

-0.119 

-0.184 

-0.320 

Dyess 

STV  1-0.606 

-0.751 

-0.781 

-0.779 

-0.518 

Ellsworth 

STV  |  0.035 

0.172 

0.212 

0.100 

0.312 

Langley 

STV  |  0.242 

0.343 

0.301 

0.382 

0.369 

Minot 

STV  1-0.255 

-0.249 

0.219 

0.280 

0.129 

Mountain  Home 

STV  1-0.384 

-0.574 

-0.446 

0.050 

0.401 

Ne 

lis 

STV  |  0.051 

0.020 

-0.125 

-0.098 

0.054 

Offutt 

STV  1-0.460 

-0.371 

-0.427 

-0.464 

-0.455 

Pope 

STV  |  0.010 

0.131  0.165 

-0.002 

-0.335 

Seymour-Johnson 

STV  |  0.033 

0.048 

0.149 

0.410 

0.391 

Shaw 

STV  1-0.113 

0.092 

0.142 

0.238 

0.370 

Whiteman 

STV  |  0.667 

0.631 

0.525 

0.471 

0.348 
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Appendix  AM:  DSV  and  TDV  Count  Correlations 


Metricj  Lag  0 

Lag  1 1  Lag  2 

Lag  3 

Lag  4 

Metric)  Lag  0  Lag  1 

Lag  2 

Lag  3  Lag  4 

Beale 

Beale 

DSV  1-0.005 

0.073 

-0.020 

-0.113 

-0.292 

TDV 

0.258 

0.477 

0.145 

0.122 

0.118 

Cannon 

Cannon 

DSV  1-0.168 

-0.086 

-0.115 

-0.020 

0.107 

TDV 

-0.356 

-0.331 

-0.324 

-0.238 

-0.108 

Davis-Monthan 

Davis-Monthan 

DSV  1-0.063 

0.037 

-0.184 

-0.129 

-0.328 

TDV 

0.007 

0.105 

0.203 

0.051 

0.379 

Dyess 

Dyess 

DSV  1-0.581 

-0.732 

-0.847 

-0.747 

-0.353 

TDV 

-0.614 

-0.632 

-0.773 

-0.404 

-0.412 

Ellsworth 

Ellsworth 

DSV  |  0.202 

0.268 

0.187 

0.060 

0.276 

TDV 

0.307 

0.310 

0.515 

0.428 

0.383 

Langley 

Langley 

DSV  |  0.355 

0.565 

0.281 

0.217 

-0.161 

TDV 

-0.047 

0.023 

0.097 

0.354 

0.454 

Minot 

Minot 

DSV  1-0.146 

-0.215 

0.218 

0.290 

0.115 

TDV  -0.235  -0.094 

-0.127 

-0.166 

-0.299 

Mountain  Home 

Mountain  Home 

DSV  1-0.237 

-0.487 

-0.408 

0.100 

0.201 

TDV  -0.332  -0.094 

0.204  0.560 

0.267 

Ne 

lis 

Nellis 

DSV  1-0.160 

-0.276 

-0.222 

-0.149 

-0.197 

TDV 

0.123 

0.101 

0.086 

0.099 

0.240 

Offutt 

Offutt 

DSV  1-0.355 

-0.277 

-0.335 

-0.367 

-0.387 

TDV 

-0.417 

-0.359 

-0.374 

-0.389 

-0.320 

Pope 

Pope 

DSV  1-0.152 

0.101 

0.036 

0.101 

0.400 

TDV 

-0.550 

-0.599 

-0.266 

-0.340 

-0.708 

Seymour- Johnson 

Seymour-Johnson 

DSV  |  0.199 

0.247 

0.204 

0.240 

0.340 

TDV 

-0.306 

-0.321 

-0.206 

0.127 

0.081 

Shaw 

Shaw 

DSV  |  0.514 

0.583 

0.598 

0.522 

0.464 

TDV 

0.213 

0.143 

0.193 

0.251 

0.158 

Whiteman 

Whiteman 

DSV  |  0.091 

0.035 

-0.002 

0.098 

0.079 

TDV 

0.075 

0.087 

-0.047 

-0.156 

-0.174 
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Appendix  AN:  FSE  and  MSE  Rate  Correlations 
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Appendix  AO:  Combined  and  Ground  Mishap  Count  Correlations 
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Appendix  AP:  Flight  Mishaps  and  In-Flight  Emergency  Rate  Correlations 


183 


Appendix  AQ:  QVI  and  PE  Pass  Rate  Correlations 
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Appendix  AR:  Key  Task  List  (KTL)  and  Phase  KTL  Pass  Rate  Correlations 
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Appendix  AS:  Recur  and  Repeat  Rate  Correlations 
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Appendix  AT :  Barksdale  AFB  Data 


Baiksdale  |2BW|  Port-1 


Flight 

Hours 

MXG 

2A2W 

Manning 

OA 

Manning 

Effect 

(rate) 

Break 

(rate) 

Fix 

(rate) 

Flying 

Sclied 

Effect 

(rate) 

MX 

Sclied 

Effect 

(rate) 

Abort 

(rate) 

IFE 

(rate) 

MX  Ops 
Devs 
(count) 

MC 

Rate 

Repeat 

Rate 

Recur 

Rate 

TNMCM 

Rate 

CANN 

Rate 

DOPs 

(count) 

FODs 

(count) 

Combined 

Mishaps 

(count) 

1161.7 

0.952 

0.541 

0.750 

0.703 

0.976 

0.080 

40 

0.811 

0.031 

0.038 

0.154 

0.382 

2 

4 

3 

1175.9 

0.952 

0.614 

0.651 

0.577 

0.944 

0.136 

36 

0.714 

0.029 

0.043 

0.236 

0.643 

2 

4 

1 

2131.6 

0.952 

0.546 

0.515 

0.797 

0.871 

0.029 

29 

0.676 

0.049 

0.044 

0.257 

0.534 

2 

4 

2 

2383.2 

0.952 

0.442 

0.517 

0.824 

0.848 

0.026 

26 

0.619 

0.029 

0.038 

0.255 

0.536 

2 

7 

1 

1307.5 

0.952 

0.561 

0.677 

0.050 

0.837 

0.109 

50 

0.686 

0.012 

0.033 

0.228 

0.801 

2 

7 

0 

1382.2 

0.952 

0.484 

0.648 

0.613 

0.735 

0.081 

44 

0.715 

0.014 

0.024 

0.196 

0.401 

2 

7 

0 

1373.8 

0.952 

0.589 

0.613 

0.681 

0.891 

0.053 

35 

0.723 

0.015 

0.017 

0.206 

0.317 

1 

10 

1 

1087.1 

0.952 

0.634 

0.627 

0.667 

0.846 

0.065 

31 

0.723 

0.019 

0.015 

0.172 

0.351 

1 

10 

1 

1097.3 

0.952 

0.576 

0.700 

0.640 

0.914 

0.079 

37 

0.787 

0.017 

0.017 

0.160 

0.209 

1 

10 

0 

1035.8 

0.952 

0.596 

0.781 

0.619 

0.952 

0.069 

50 

0.770 

0.019 

0.018 

0.194 

0.242 

4 

11 

0 

1278.7 

0.952 

0.510 

0.646 

0.620 

0.939 

0.089 

59 

0.734 

0.020 

0.027 

0.218 

0.144 

4 

11 

0 

1151.0 

0.952 

0.583 

0.755 

0.591 

0.896 

0.074 

58 

0.716 

0.024 

0.024 

0.219 

0.240 

4 

11 

0 

1251.2 

0.871 

0.952 

0.603 

0.790 

0.472 

0.923 

0.070 

80 

0.724 

0.012 

0.031 

0.241 

0.310 

5 

10 

0 

1411.0 

0.867 

0.952 

0.656 

0.685 

0.460 

0.944 

0.125 

91 

0.706 

0.035 

0.033 

0.254 

0.370 

5 

10 

0 

1565.2 

0.871 

0.952 

0.596 

0.742 

0.753 

0.939 

0.057 

42 

0.765 

0.007 

0.017 

0.227 

0.221 

5 

10 

0 

1242.5 

0.869 

0.952 

0.525 

0.736 

0.524 

0.955 

0.091 

73 

0.731 

0.015 

0.017 

0.205 

0.272 

4 

9 

0 

1057.7 

0.928 

0.952 

0.525 

0.737 

0.612 

0.965 

0.057 

39 

0.797 

0.015 

0.020 

0.169 

0.359 

4 

9 

1 

1272.1 

0.923 

0.952 

0.549 

0.703 

0.447 

0.940 

0.090 

67 

0.765 

0.022 

0.028 

0.161 

0.240 

4 

9 

0 

118.1 

0.915 

0.952 

0.548 

0.720 

0.628 

0.990 

0.103 

58 

0.294 

0.017 

0.020 

0.183 

0.224 

2 

7 

0 

929.7 

0.949 

0.952 

0.522 

0.747 

0.605 

0.989 

0.108 

43 

0.844 

0.028 

0.030 

0.123 

0.297 

2 

7 

0 

753.0 

0.930 

0.952 

0.527 

0.818 

0.597 

0.990 

0.058 

35 

0.849 

0.017 

0.017 

0.112 

0.274 

2 

7 

0 

869.9 

0.919 

0.952 

0.601 

0.745 

0.717 

0.993 

0.036 

35 

0.827 

0.013 

0.012 

0.131 

0.215 

1 

5 

0 

1068.7 

0.887 

0.952 

0.509 

0.833 

0.599 

0.968 

0.090 

72 

0.754 

0.031 

0.019 

0.171 

0.236 

1 

5 

0 

727.4 

0.896 

0.952 

0.608 

0.703 

0.528 

0.990 

0.112 

63 

0.745 

0.023 

0.032 

0.209 

0.496 

1 

5 

0 
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Barksdale 

2BW)  Part-2 

Flight 

Mishaps 

(count) 

Ground 

Mishaps 

(count) 

STVs 

(count) 

DSVs 

(count) 

TDVs 

(count) 

DRs 

Sub 

(count) 

TO  Imp 
Sub 
(count) 

QVI 

Pass 

(rate) 

KTL 

Pass 

(rate) 

Phase 

KTL 

(rate) 

PE 

Pass 

(rate) 

2 

1 

20 

11 

1 

39 

4 

0.885 

0.952 

0.916 

0.996 

1 

0 

6 

0 

2 

30 

8 

0.916 

0.909 

1.000 

0.979 

0 

2 

3 

1 

1 

31 

8 

0.955 

0.875 

0.846 

1.000 

0 

1 

4 

0 

1 

24 

7 

0.897 

0.884 

1.000 

0.989 

0 

0 

17 

11 

1 

17 

13 

0.846 

0.833 

1.000 

1.000 

0 

0 

26 

9 

0 

30 

9 

0.853 

0.925 

0.925 

1.000 

0 

1 

15 

4 

4 

23 

23 

0.861 

0.896 

0.861 

0.985 

0 

1 

8 

2 

1 

20 

11 

0.917 

0.967 

0.975 

0.979 

0 

0 

9 

7 

0 

29 

15 

0.847 

0.916 

0.883 

1.000 

0 

0 

13 

9 

2 

49 

27 

0.939 

0.966 

0.980 

0.996 

0 

0 

27 

12 

3 

23 

18 

0.873 

0.936 

0.950 

0.991 

0 

0 

28 

16 

7 

26 

10 

0.858 

0.974 

0.966 

0.988 

0 

0 

43 

32 

6 

45 

30 

0.856 

0.903 

0.852 

0.993 

0 

0 

43 

32 

7 

26 

17 

0.881 

0.890 

0.863 

0.993 

0 

0 

28 

12 

7 

31 

36 

0.852 

0.864 

0.800 

0.988 

0 

0 

11 

2 

7 

49 

23 

0.982 

0.943 

0.916 

0.990 

0 

1 

24 

9 

7 

17 

12 

0.931 

0.943 

0.954 

0.995 

0 

0 

8 

3 

1 

24 

11 

0.924 

0.986 

0.980 

0.990 

0 

0 

27 

20 

2 

19 

41 

0.925 

0.816 

0.750 

0.991 

0 

0 

15 

7 

1 

40 

63 

0.885 

0.889 

0.857 

0.995 

0 

0 

7 

6 

0 

30 

16 

0.914 

0.911 

0.918 

0.992 

0 

0 

11 

5 

0 

12 

17 

0.922 

1.000 

1.000 

0.990 

0 

0 

7 

2 

0 

13 

22 

0.925 

0.916 

0.891 

0.990 

0 

0 

14 

6 

2 

26 

19 

0.851 

0.905 

0.871 

0.990 
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Appendix  AU:  Beale  AFB  Data 


Beale  AFB  (9RW|  Pait-1 

Flight 

Homs 

MXG 

2A2W 

Manning 

OA 

Manning 

Effect 

(late) 

Bieak 

(late) 

Fix 

(rate) 

Flying 

Sclieil 

Effect 

(late) 

MX 

Scheil 

Effect 

(tate) 

Abort 

(late) 

IFE 

(rate) 

MX/Ops 

Devs 

(count) 

MC 

(late) 

Repeat 

(tate) 

Recm 

(rate) 

TNMCM 

(rate) 

CANN 

(rate) 

DOPs 

(count) 

FODs 

(count) 

Combined 

Mishaps 

(count) 

Jan  03 

247 

0.658 

0.123 

0.676 

0.580 

1.000 

0.036 

13 

0.784 

0.000 

0.026 

0.164 

0.032 

0 

5 

0 

Fell  03 

333.6 

0.658 

0.158 

0.700 

0.801 

0.970 

0.035 

12 

0.793 

0.000 

0.028 

0.167 

0.090 

0 

0 

0 

Mai  03 

216.2 

0.608 

0.232 

0.785 

0.866 

0.935 

0.043 

17 

0.754 

0.000 

0.071 

0.198 

0.021 

0 

1 

0 

Api  03 

375.1 

0.630 

0.228 

0.789 

0.890 

1.000 

0.044 

12 

0.761 

0.031 

0.031 

0.176 

0.021 

0 

9 

0 

May  03 

442.3 

0.630 

0.208 

0.720 

0.881 

0.967 

0.049 

19 

0.795 

0.025 

0.050 

0.133 

0.015 

0 

3 

1 

Jim  03 

344.2 

0.630 

0.191 

0.630 

0.829 

0.974 

0.056 

28 

0.759 

0.012 

0.000 

0.188 

0.028 

1 

8 

0 

Jul  03 

333.5 

0.586 

0.135 

0.650 

0.880 

0.942 

0.056 

19 

0.758 

0.000 

0.042 

0.195 

0.010 

0 

5 

0 

Aiii|  03 

319.8 

0.586 

0.255 

0.621 

0.833 

0.971 

0.071 

30 

0.72 

0.013 

0.000 

0.201 

0.031 

0 

4 

1 

Sep  03 

328.7 

0.586 

0.165 

0.795 

0.891 

0.982 

0.037 

13 

0.823 

0.055 

0.000 

0.114 

0.011 

0 

7 

0 

Oct  03 

411.1 

0.563 

0.14 

0.750 

0.819 

0.999 

0.021 

18 

0.777 

0.013 

0.013 

0.148 

0.053 

2 

6 

0 

Nov  03 

273.8 

0.563 

0.145 

0.692 

0.912 

1.000 

0.036 

18 

0.776 

0.019 

0.019 

0.198 

0.030 

0 

4 

1 

Dec  03 

317.7 

0.563 

0.195 

0.673 

0.840 

1.000 

0.047 

15 

0.706 

0.000 

0.000 

0.204 

0.028 

0 

10 

0 

Jan  04 

323.9 

0.739 

0.563 

0.147 

0.718 

0.812 

1.000 

0.022 

2 

0.826 

0.000 

0.000 

0.138 

0.034 

0 

5 

1 

Fell  04 

289.5 

0.799 

0.563 

0.16 

0.725 

0.783 

1.000 

0.024 

13 

0.751 

0.000 

0.000 

0.203 

0.020 

0 

10 

0 

Mai  04 

422.6 

0.829 

0.531 

0.166 

0.680 

0.889 

1.000 

0.023 

16 

0.787 

0.014 

0.014 

0.168 

0.010 

0 

7 

1 

Apr  04 

364.9 

0.841 

0.563 

0.142 

0.600 

0.818 

0.983 

0.040 

30 

0.688 

0.019 

0.019 

0.261 

0.041 

1 

5 

0 

May  04 

274.8 

0.814 

0.563 

0.165 

0.619 

0.920 

1.000 

0.065 

18 

0.743 

0.106 

0.106 

0.187 

0.024 

0 

15 

0 

Jun  04 

384 

0.805 

0.563 

0.196 

0.678 

0.856 

0.889 

0.055 

34 

0.682 

0.052 

0.052 

0.281 

0.030 

0 

10 

0 

Jul  04 

245.1 

0.828 

0.563 

0.258 

0.619 

0.893 

0.970 

0.076 

18 

0.659 

0.071 

0.071 

0.280 

0.037 

0 

12 

2 

Aui|  04 

322.7 

0.891 

0.531 

0.221 

0.760 

0.912 

0.969 

0.034 

15 

0.706 

0.065 

0.065 

0.238 

0.048 

0 

6 

0 

Sep  04 

234.7 

0.878 

0.563 

0.207 

0.700 

0.921 

0.922 

0.069 

14 

0.772 

0.040 

0.040 

0.199 

0.029 

0 

8 

3 

Oct  04 

305.1 

0.849 

0.563 

0.19 

0.620 

0.869 

1.000 

0.063 

25 

0.731 

0.000 

0.037 

0.247 

0.034 

0 

8 

2 

Nov  04 

344.7 

0.857 

0.563 

0.203 

0.685 

0.836 

0.957 

0.066 

21 

0.206 

0.014 

0.028 

0.254 

0.015 

0 

10 

0 

Dec  04 

333.9 

0.862 

0.688 

0.149 

0.696 

0.902 

0.960 

0.031 

19 

0.719 

0.076 

0.000 

0.268 

0.006 

0 

10 

0 
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Beale  AFB 

9RW)  Part-2 

Flight 

Mishaps 

(count) 

Ground 

Mishaps 

(count) 

STVs 

(count) 

DSVs 

(count) 

TDVs 

(count) 

DRs 

Sub 

(count) 

TO  Imp 
Sub 
(count) 

QVI 

Pass 

(rate) 

KTL 

Pass 

(rate) 

Phase 

KTL 

(rate) 

PE 

Pass 

(rate) 

0 

0 

9 

2 

1 

8 

6 

0.913 

0.912 

1.000 

0.917 

0 

0 

9 

0 

1 

9 

10 

0.943 

0.956 

1.000 

0.917 

0 

0 

15 

5 

2 

13 

17 

0.932 

0.941 

1.000 

0 

0 

9 

3 

3 

10 

16 

0.919 

0.958 

1.000 

1.000 

1 

0 

9 

2 

3 

20 

12 

0.930 

1.000 

1.000 

1.000 

0 

0 

22 

3 

3 

18 

21 

0.930 

0.964 

0.971 

0 

0 

23 

3 

3 

8 

7 

0.937 

0.938 

0.000 

0.917 

0 

1 

9 

0 

1 

14 

0 

0.928 

0.933 

1.000 

0.962 

0 

0 

8 

2 

0 

8 

7 

0.956 

0.909 

1.000 

1.000 

0 

0 

17 

5 

2 

19 

2 

0.955 

0.931 

1.000 

1.000 

1 

0 

12 

2 

2 

22 

2 

0.957 

0.909 

1.000 

1.000 

0 

0 

8 

2 

1 

18 

4 

0.947 

0.962 

1.000 

1.000 

1 

0 

9 

0 

2 

9 

9 

0.934 

0.957 

1.000 

0 

0 

11 

0 

0 

12 

2 

0.929 

0.878 

0.000 

1.000 

1 

0 

8 

3 

1 

15 

9 

0.944 

0.906 

0.000 

1.000 

0 

0 

10 

5 

0 

14 

14 

0.955 

0.920 

1.000 

1.000 

0 

0 

9 

0 

0 

15 

11 

0.952 

0.868 

0.000 

1.000 

0 

0 

5 

0 

0 

21 

16 

0.959 

0.873 

0.000 

1.000 

1 

1 

8 

1 

1 

7 

24 

0.970 

0.962 

1.000 

0.926 

0 

0 

5 

1 

1 

19 

8 

0.959 

0.962 

1.000 

1.000 

2 

1 

6 

1 

1 

6 

19 

0.927 

0.905 

1.000 

1.000 

1 

1 

2 

1 

0 

28 

38 

0.931 

0.827 

0.500 

1.000 

0 

0 

10 

2 

2 

23 

17 

0.955 

0.937 

1.000 

1.000 

0 

0 

5 

2 

1 

14 

24 

0.959 

0.918 

1.000 

0.971 
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Appendix  AV:  Cannon  AFB  Data 


Cannon  AFB  (27  FS|  Pait-1 


Flight 

Homs 

MXG 

2A2W 

Manning 

OA 

Manning 

Effect 

(late) 

Bieak 

(late) 

Fix  (tale) 

Flying 

Sclieil 

Effect 

(rate) 

MX  Soiled 
Effect 
(rate) 

Alioil 

(late) 

IFE 

(rate) 

MX  Ops 
Devs 
(count) 

MC 

(rate) 

Repeat 

(late) 

Recm 

(rate) 

TNMCM 

(rate) 

CANN 

(rate) 

DOPs 

(count) 

FODs 

(count) 

Combined 

Mishaps 

(count) 

Jan  03 

1622.3 

0.895 

0.112 

0.857 

0.854 

0.962 

0.051 

0.010 

55 

0.849 

0.018 

0.044 

0.074 

0.084 

3 

13 

0 

Feb  03 

1256.7 

0.895 

0.084 

0.848 

0.754 

0.942 

0.046 

0.005 

42 

0.840 

0.019 

0.035 

0.093 

0.126 

0 

11 

1 

Mai  03 

1971.4 

0.895 

0.123 

0.846 

0.768 

0.945 

0.056 

0.009 

60 

0.823 

0.033 

0.043 

0.120 

0.120 

3 

14 

0 

Apr  03 

1811.4 

0.900 

0.134 

0.771 

0.821 

0.949 

0.058 

0.007 

76 

0.845 

0.043 

0.025 

0.097 

0.107 

1 

13 

0 

May  03 

1544.6 

0.904 

0.100 

0.821 

0.870 

0.966 

0.048 

0.006 

44 

0.887 

0.030 

0.043 

0.056 

0.097 

1 

10 

0 

Jim  03 

1331.3 

0.904 

0.095 

0.808 

0.861 

0.957 

0.073 

0.006 

58 

0.866 

0.033 

0.041 

0.055 

0.072 

3 

31 

3 

Jill  03 

1394.9 

0.904 

0.129 

0.779 

0.841 

0.983 

0.063 

0.010 

72 

0.848 

0.024 

0.043 

0.094 

0.096 

0 

15 

0 

Aiii|  03 

1365.7 

0.904 

0.092 

0.857 

0.798 

0.979 

0.058 

0.010 

76 

0.862 

0.017 

0.026 

0.081 

0.096 

1 

14 

1 

Sep  03 

1036.9 

0.878 

0.115 

0.851 

0.794 

0.988 

0.047 

0.015 

32 

0.862 

0.021 

0.040 

0.075 

0.144 

3 

14 

0 

Oct  03 

1728.7 

0.878 

0.100 

0.677 

0.719 

0.981 

0.067 

0.009 

80 

0.851 

0.028 

0.031 

0.095 

0.095 

0 

24 

1 

Nov  03 

1399.3 

0.878 

0.077 

0.690 

0.700 

0.994 

0.067 

0.006 

94 

0.861 

0.027 

0.023 

0.088 

0.091 

2 

13 

0 

Dec  03 

1326.2 

0.878 

0.102 

0.804 

0.798 

0.979 

0.081 

0.007 

102 

0.854 

0.024 

0.031 

0.091 

0.109 

3 

12 

0 

Jan  04 

1658.4 

0.784 

(1154 

0,104 

0.723 

0.797 

0.989 

0.075 

0.009 

96 

0.858 

0.027 

0.036 

0.074 

0.088 

2 

9 

0 

Feb  04 

1358.0 

0.779 

(1.854 

0,104 

0.730 

0.585 

0.973 

0.072 

0.006 

117 

0.835 

0,020 

0.035 

0.114 

0.100 

0 

16 

0 

Mai  04 

1757.0 

0.777 

0.854 

0,096 

0.773 

0.812 

0.981 

0.057 

0.007 

75 

0.848 

0.031 

0.032 

0.107 

0.087 

1 

10 

0 

Api  04 

1522,1 

0.771 

0.854 

0.086 

0.774 

0.810 

0.994 

0.062 

0.006 

66 

0.883 

0.014 

0.017 

0.084 

0.072 

0 

12 

0 

May  04 

1602.3 

0.764 

0.854 

0.087 

0.819 

0.737 

0.971 

0.054 

0.012 

116 

0.849 

0.016 

0.018 

0.099 

0.067 

1 

16 

0 

Jim  04 

1638.7 

0.758 

0.854 

0.104 

0.776 

0.773 

0.980 

0.061 

0.016 

84 

0.814 

0.033 

0.031 

0.107 

0.071 

1 

12 

0 

Jul  04 

1117.2 

0.820 

0.854 

0.084 

0.726 

0.829 

0.993 

0.064 

0.015 

61 

0.860 

0.019 

0.033 

0.089 

0.069 

5 

11 

0 

Aik)  04 

1458.8 

0.848 

0.854 

0.086 

0.773 

0.745 

0.994 

0.054 

0.013 

52 

0.861 

0.029 

0.027 

0.073 

0.074 

1 

5 

0 

Sep  04 

847.8 

0.841 

0.860 

0.100 

0.803 

0.662 

0.984 

0.083 

0.015 

66 

0.877 

0.022 

0.032 

0,075 

0.097 

3 

13 

0 

Oct  04 

1265.0 

0.792 

0.865 

0.117 

0.733 

0.794 

0.988 

0.080 

0.012 

80 

0.838 

0.031 

0.024 

0.101 

0.079 

1 

10 

1 

Nov  04 

1018.3 

0.770 

0.865 

0.101 

0.756 

0.767 

0.950 

0.081 

0.019 

146 

0.835 

0.019 

0.025 

0.113 

0.106 

2 

15 

0 

Dec  04 

1426.8 

0.753 

0.865 

0.105 

0.822 

0.803 

0.977 

0.073 

0.009 

87 

0.870 

0.014 

0.026 

0.069 

0.076 

5 

22 

0 
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Cannon  AF 

3(27  FS) 

3art-2 

Flight 

Mishaps 

(count) 

Ground 

Mishaps 

(count) 

STVs 

(count) 

DSVs 

(count) 

TDVs 

(count) 

DRs  Sub 
(count) 

TO  Imp 
Sub 
(count) 

QVI 

Pass 

(rate) 

KTL 

Pass 

(rate) 

Phase 

KTL 

(rate) 

PE 

Pass 

(rate) 

0 

0 

11 

1 

2 

0.861 

0.869 

0.625 

1.000 

1 

0 

15 

0 

1 

0.869 

0.882 

1.000 

0.983 

0 

0 

9 

4 

0 

0.865 

0.860 

0.714 

0.942 

0 

0 

7 

3 

1 

0.883 

0.869 

1.000 

0.973 

0 

0 

8 

1 

0 

0.877 

0.902 

0.833 

1.000 

0 

3 

18 

1 

0 

0.892 

0.909 

1.000 

0.972 

0 

0 

11 

3 

1 

0.878 

0.926 

0.800 

0.982 

0 

1 

7 

1 

0 

0.889 

0.903 

0.333 

0.978 

0 

0 

10 

4 

0 

0.871 

0.892 

0.857 

0.989 

0 

1 

0 

0 

0 

0.907 

0.933 

0.857 

0.991 

0 

0 

6 

4 

0 

0.928 

0.939 

1.000 

1.000 

0 

0 

6 

2 

2 

17 

25 

0.910 

0.888 

0.800 

0.990 

0 

0 

1 

1 

0 

13 

7 

0.905 

0.896 

1.000 

0.988 

0 

0 

7 

0 

1 

17 

8 

0.880 

0.819 

1.000 

0.988 

0 

0 

4 

1 

1 

25 

11 

0.930 

0.914 

0.714 

0.980 

0 

0 

4 

1 

1 

19 

15 

0.914 

0.918 

0.900 

0.987 

0 

0 

17 

5 

7 

15 

45 

0.954 

0.939 

0.800 

0.983 

0 

0 

9 

3 

2 

11 

25 

0.921 

0.880 

1.000 

0.991 

0 

0 

5 

0 

0 

12 

40 

0.932 

0.906 

0.800 

0.984 

0 

0 

13 

3 

1 

7 

12 

0.929 

0.939 

0.667 

0.991 

0 

0 

21 

6 

4 

11 

14 

0.911 

0.914 

1.000 

0.989 

0 

1 

20 

4 

3 

11 

12 

0.905 

0.891 

0.500 

0.991 

0 

0 

20 

6 

4 

6 

17 

0.905 

0.890 

1.000 

0.985 

0 

0 

10 

4 

0 

9 

14 

0.917 

0.960 

1.000 

0.991 
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Appendix  AW :  Davis-Monthan  AFB  Data 


D.ivis-Month.in  <355  FW|  Pait-1 


A-10 

(Opl 

A-10 

(Tin) 

A-10 

(Op) 

A-10 

(Tm) 

A-10 

(Op) 

A-10 

(Tin! 

A-10 

(Op) 

A-10 

(Tm) 

A-10 

(Op) 

A-10 

(Tin) 

A-10 

(Op) 

A-10 

(Tm) 

A-10 

(Op) 

A-10 

(Trn| 

A-10 

(Op) 

A-10 

(Tin) 

Flight  Hours 

MXG 

2A2W 

Manning 

OA 

Manning 

Effect 

(rate) 

Bieak 

(rate) 

Fix 

late) 

Flying 
Scheil 
Effect  |iate| 

MX  Scheil 
Effect  (rate) 

Abort  (rdto) 

IFE 

rate) 

MX  Ops 
Devs 

(COllIlt) 

Jan  03 

921.7 

1628.8 

0.802 

0.057 

0.110 

0.786 

0.822 

0.908 

0.928 

0.905 

0.984 

0.042 

0.031 

0.010 

0.022 

6 

27 

Feh  03 

724.1 

1344.4 

0.802 

0.082 

0.113 

0.710 

0.926 

0.884 

0.841 

0.821 

1.000 

0.046 

0.056 

0.013 

0.017 

24 

50 

Mar  03 

844.0 

1428.0 

0.802 

0.085 

0.115 

0.725 

0.845 

0.833 

0.867 

0.975 

0.969 

0.043 

0.051 

0.019 

0.022 

44 

58 

Api  03 

779.2 

1540.0 

0.839 

0.095 

0.105 

0.667 

0.785 

0.922 

0.816 

0.955 

0.996 

0.033 

0.045 

0.012 

0.029 

22 

109 

May  03 

931.2 

1391.5 

0.843 

0.120 

0.115 

0.746 

0.783 

0.842 

0.792 

0.953 

0.995 

0.057 

0.057 

0.017 

0.019 

77 

114 

Jim  03 

810.5 

1466.0 

0.880 

0.136 

0.098 

0.833 

0.857 

0.744 

0.789 

0.933 

1.000 

0.044 

0.058 

0.014 

0.021 

40 

79 

Jul  03 

510.1 

1416.2 

0.880 

0.127 

0.100 

0.500 

0.690 

0.627 

0.724 

1.000 

1.000 

0.066 

0.053 

0.025 

0.027 

76 

150 

Aiii|  03 

723.0 

1029.3 

0.880 

0.115 

0.127 

0.778 

0.806 

0.724 

7.939 

1.000 

0.995 

0.047 

0.071 

0.015 

0.037 

88 

104 

Sep  03 

732.2 

1341.3 

0.917 

0.114 

0.122 

0.674 

0.787 

0.744 

0.801 

0.854 

0.982 

0.058 

0.068 

0.013 

0.021 

81 

80 

Oct  03 

623.1 

1681.2 

0.800 

0.093 

0.095 

0.533 

0.756 

0.770 

0.893 

0.953 

0.966 

0.047 

0.073 

0.009 

0.013 

51 

94 

Nov  03 

1528.1 

1178.1 

0.759 

0.062 

0.143 

0.615 

0.747 

0.899 

0.795 

1.000 

0.858 

0.019 

0.083 

0.007 

0.033 

8 

104 

Dec  03 

2014.4 

1157.2 

0.848 

0.077 

0.120 

0.852 

0.857 

0.982 

0.835 

0.878 

0.951 

0.011 

0.052 

0.000 

0.015 

4 

86 

Jan  04 

1865.8 

1265.1 

0.789 

0.787 

0.097 

0.130 

0.791 

0.914 

0.943 

0.900 

1.000 

0.981 

0.028 

0.049 

0.006 

0.027 

13 

50 

Feb  04 

1979.1 

1371.7 

0.785 

0.820 

0.074 

0.160 

0.780 

0.832 

0.980 

0.891 

1.000 

0.927 

0.025 

0.063 

0.003 

0.030 

13 

68 

Mar  04 

2023.2 

1655.6 

0.812 

0.840 

0.053 

0.153 

0.829 

0.844 

0.995 

0.880 

1.000 

0.960 

0.027 

0.061 

0.003 

0.016 

15 

80 

Api  04 

842.8 

1622.6 

0.909 

0.840 

0.071 

0.100 

0.765 

0.810 

0.880 

0.827 

0.937 

0.960 

0.032 

0.071 

0.004 

0.014 

21 

111 

May  04 

494.6 

1475.0 

0.911 

0.840 

0.100 

0.092 

0.704 

0.794 

0.682 

0.902 

0.916 

0.954 

0.057 

0.056 

0.007 

0.019 

29 

72 

Jim  04 

979.4 

1749.5 

0.914 

0.843 

0.132 

0.104 

0.794 

0.756 

0.862 

0.894 

0.981 

0.991 

0.052 

0.074 

0.025 

0.032 

51 

101 

Jnl  04 

716.0 

1280.4 

0.916 

0.848 

0.127 

0.116 

0.792 

0.622 

0.836 

0.823 

0.966 

0.990 

0.065 

0.069 

0.013 

0.015 

64 

75 

Ami  04 

933.3 

1572.6 

0.971 

0.848 

0.129 

0.107 

0.779 

0.750 

0.787 

0.852 

0.926 

0.976 

0.047 

0.067 

0.034 

0.040 

68 

96 

Sep  04 

666.6 

1287.3 

0.967 

0.883 

0.079 

0.059 

0.828 

0.857 

0.803 

0.835 

0.945 

0.915 

0.052 

0.068 

0.008 

0.015 

65 

50 

Oct  04 

999.3 

1458.8 

0.937 

0.814 

0.110 

0.113 

0.810 

0.838 

0.897 

0.882 

0.992 

0.973 

0.039 

0.058 

0.015 

0.028 

32 

45 

Nov  04 

799.4 

1384.2 

0.928 

0.848 

0.092 

0.102 

0.692 

0.805 

0.905 

0.956 

0.987 

0.984 

0.061 

0.061 

0.021 

0.024 

52 

56 

Dec  04 

930.1 

1195.4 

0.907 

0.843 

0.106 

0.082 

0.792 

0.714 

0.768 

0.857 

1.000 

0.983 

0.071 

0.062 

0.020 

0.022 

64 

66 

193 


Davis-Monthan  (' 

55  F W 

)  Part-2 

A-10 

(Op) 

A-10 

(Tm) 

A-10 

(Op) 

A-10 

(Trn) 

A-10 

(Op) 

A-10 

(Trn) 

A-10 

(Op) 

A-10 

(Trn) 

A-10 

(Op) 

A-10 

(Trn) 

MC  (rate) 

Repeat 

(rate) 

Recur 

(rate) 

TNMCM 

CANN  (rate) 

DOPs 

(count) 

FODs 

(count) 

Combined 

Mishaps 

(count) 

Flight 

Mishaps 

(count) 

Ground 

Mishaps 

(count) 

0.730 

0.706 

0.042 

0.003 

0.034 

0.025 

0.228 

0.217 

0.094 

0.088 

2 

2 

1 

0 

0 

0.685 

0.749 

0.011 

0.013 

0.017 

0.021 

0.262 

0.184 

0.106 

0.119 

0 

1 

1 

0 

1 

0.696 

0.684 

0.032 

0.013 

0.041 

0.019 

0.239 

0.263 

0.113 

0.111 

3 

0 

2 

2 

0 

0.656 

0.659 

0.051 

0.014 

0.028 

0.017 

0.297 

0.269 

0.132 

0.130 

1 

0 

1 

0 

0 

0.673 

0.599 

0.021 

0.023 

0.030 

0.023 

0.274 

0.291 

0.128 

0.084 

2 

0 

2 

2 

0 

0.601 

0.650 

0.015 

0.013 

0.015 

0.016 

0.277 

0.237 

0.107 

0.108 

0 

3 

0 

0 

0 

0.472 

0.854 

0.027 

0.011 

0.038 

0.014 

0.346 

0.032 

0.211 

0.118 

3 

1 

2 

0 

0 

0.518 

0.588 

0.037 

0.023 

0.014 

0.006 

0.401 

0.338 

0.202 

0.200 

1 

0 

1 

0 

1 

0.581 

0.722 

0.033 

0.003 

0.021 

0.000 

0.357 

0.208 

0.198 

0.164 

0 

0 

1 

1 

1 

0.715 

0.714 

0.005 

0.014 

0.011 

0.003 

0.225 

0.221 

0.134 

0.151 

0 

1 

0 

0 

0 

0.803 

0.710 

0.014 

0.019 

0.000 

0.014 

0.055 

0.224 

0.060 

0.189 

3 

0 

1 

1 

0 

0.789 

0.784 

0.028 

0.006 

0.014 

0.022 

0.082 

0.172 

0.189 

0.110 

0 

1 

0 

0 

0 

0.744 

0.832 

0.030 

0.003 

0.010 

0.003 

0.152 

0.122 

0.130 

0.109 

0 

1 

0 

0 

0 

0.782 

0.770 

0.019 

0.019 

0.006 

0.014 

0.113 

0.178 

0.096 

0.095 

2 

1 

2 

1 

1 

0.866 

0.811 

0.000 

0.013 

0.023 

0.013 

0.079 

0.151 

0.018 

0.118 

0 

0 

0 

0 

1 

0.776 

0.734 

0.000 

0.006 

0.000 

0.014 

0.167 

0.228 

0.050 

0.070 

2 

0 

0 

0 

1 

0.679 

0.752 

0.043 

0.003 

0.009 

0.011 

0.254 

0.216 

0.078 

0.045 

3 

0 

1 

1 

0 

0.699 

0.793 

0.039 

0.006 

0.004 

0.008 

0.245 

0.181 

0.048 

0.058 

6 

0 

0 

0 

0 

0.688 

0.800 

0.012 

0.000 

0.000 

0.014 

0.269 

0.171 

0.095 

0.080 

2 

0 

1 

1 

1 

0.665 

0.782 

0.034 

0.025 

0.034 

0.025 

0.287 

0.188 

0.076 

0.087 

0 

0 

0 

0 

1 

0.641 

0.816 

0.006 

0.021 

0.006 

0.021 

0.288 

0.159 

0.066 

0.051 

2 

0 

1 

0 

0 

0.711 

0.804 

0.004 

0.006 

0.004 

0.009 

0.246 

0.169 

0.104 

0.077 

1 

0 

0 

0 

1 

0.755 

0.784 

0.009 

0.008 

0.004 

0.011 

0.179 

0.178 

0.109 

0.102 

3 

1 

1 

0 

0 

0.751 

0.813 

0.004 

0.007 

0.004 

0.029 

0.200 

0.146 

0.096 

0.114 

1 

0 

0 

0 

1 
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Davis-Monthan  (355  FW)  Part-3 


STVs 

(count) 

DSVs 

(count) 

TDVs 

(count) 

DRs 

Sub 

(count) 

TO  Imp 
Sub 
(count) 

QVI 

Pass 

(rate) 

KTL 

Pass 

(rate) 

Phase 

KTL 

(rate) 

PE  Pass 
(rate) 

2 

2 

0 

28 

8 

0.913 

0.910 

0.800 

1.000 

7 

7 

0 

28 

9 

0.933 

0.887 

0.571 

1.000 

6 

6 

0 

19 

13 

0.907 

0.903 

0.429 

1.000 

3 

3 

0 

15 

8 

0.910 

0.932 

0.600 

1.000 

5 

4 

1 

25 

13 

0.927 

0.900 

0.500 

1.000 

5 

5 

0 

26 

15 

0.945 

0.889 

0.500 

1.000 

13 

13 

0 

26 

18 

0.928 

0.936 

0.500 

1.000 

10 

10 

0 

28 

15 

0.913 

0.879 

0.600 

1.000 

12 

12 

0 

30 

16 

0.906 

0.867 

0.500 

1.000 

7 

7 

0 

36 

10 

0.902 

0.959 

1.000 

1.000 

21 

21 

0 

17 

10 

0.892 

0.820 

1.000 

0.949 

7 

7 

0 

13 

2 

0.897 

0.856 

1.000 

1.000 

7 

7 

0 

76 

6 

0.918 

0.875 

1.000 

0.967 

9 

9 

0 

28 

6 

0.916 

0.950 

0.800 

0.948 

16 

16 

0 

37 

19 

0.903 

0.947 

0.000 

0.941 

18 

18 

0 

23 

11 

0.902 

0.882 

0.773 

0.991 

13 

13 

0 

24 

13 

0.915 

0.952 

0.757 

1.000 

21 

21 

0 

31 

4 

0.923 

0.840 

0.850 

1.000 

11 

3 

1 

24 

8 

0.912 

0.884 

0.804 

1.000 

11 

2 

0 

27 

14 

0.926 

0.984 

0.776 

0.989 

7 

0 

1 

22 

8 

0.908 

0.825 

0.795 

1.000 

26 

1 

3 

21 

9 

0.909 

0.873 

0.843 

1.000 

13 

4 

2 

23 

7 

0.896 

0.755 

0.850 

1.000 

7 

1 

0 

21 

6 

0.903 

0.900 

0.906 

1.000 
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Appendix  AX:  Dyess  AFB  Data 


Dyess  AFB  (7BW) 

Pait-1 

Flight 

Homs 

MXG 

2A2W 

Manning 

OA 

Manning 

Effect 

(rate) 

Bieak 

(rate) 

Fix 

(rate) 

Flying 

Schetl 

Effect 

(rate) 

MX 

Sched 

Effect 

(rate) 

Abort 

(rate) 

IFE 

(late) 

MX/Ops 

Devs 

(count) 

MC 

(rate) 

Repeat 

(rate) 

Recm 

(rate) 

TNMCM 

(rate) 

CANN 

(rate) 

DOPs 

(count) 

FODs 

(count) 

Combined 

Mishaps 

(count) 

Jan  03 

927.2 

1.000 

0.088 

0.842 

0.698 

0.937 

0.162 

0.039 

61 

0.755 

0.065 

0.058 

0.149 

0.583 

0 

2 

1 

Fell  03 

673.1 

1.000 

0.109 

0.706 

0.568 

0.927 

0.120 

0.051 

42 

0.712 

0.034 

0.044 

0.206 

1.045 

3 

1 

1 

Mar  03 

823.7 

1.000 

0.103 

0.476 

0.669 

0.898 

0.117 

0.041 

44 

0.706 

0.042 

0.035 

0.211 

0.466 

1 

0 

0 

Apr  03 

932.7 

1.000 

0.099 

0.500 

0.720 

0.978 

0.108 

0.057 

49 

0.692 

0.048 

0.041 

0.211 

0.628 

0 

0 

0 

May  03 

795.9 

1.000 

0.133 

0.583 

0.702 

0.981 

0.140 

0.054 

37 

0.764 

0.048 

0.040 

0.139 

0.707 

2 

0 

0 

Jim  03 

642.5 

1.000 

0.169 

0.552 

0.643 

0.964 

0.132 

0.045 

52 

0.743 

0.058 

0.058 

0.209 

0.612 

5 

1 

0 

Jill  03 

924.9 

1.000 

0.099 

0.542 

0.660 

0.953 

0.160 

0.078 

70 

0.676 

0.071 

0.053 

0.249 

0.605 

2 

0 

0 

Aiii|  03 

810.8 

1.000 

0.089 

0.588 

0.633 

0.941 

0.155 

0.041 

53 

0.646 

0.066 

0.047 

0.244 

0.755 

2 

1 

2 

Sep  03 

973 

1.000 

0.129 

0.500 

0.714 

0.948 

0.084 

0.059 

31 

0.647 

0.087 

0.040 

0.238 

1.000 

2 

0 

1 

Oct  03 

966 

1.000 

0.101 

0.862 

0.816 

0.992 

0.044 

0.031 

32 

0.659 

0.036 

0.034 

0.241 

0.455 

3 

3 

1 

Nov  03 

785.2 

1.000 

0.072 

0.538 

0.718 

0.978 

0.105 

0.006 

35 

0.732 

0.046 

0.051 

0.204 

0.567 

1 

0 

0 

Dec  03 

729.5 

1.000 

0.046 

0.778 

0.764 

0.962 

0.108 

0.031 

40 

0.759 

0.048 

0.037 

0.172 

0.487 

0 

4 

1 

Jan  04 

717.8 

0.751 

1.000 

0.050 

0.556 

0.714 

0.955 

0.082 

0.022 

36 

0.740 

0.067 

0.032 

0.217 

0.796 

3 

1 

1 

Feb  04 

748.4 

0.757 

1.000 

0.077 

0.643 

0.593 

0.993 

0.145 

0.023 

39 

0.775 

0.052 

0.044 

0.187 

0.508 

0 

1 

2 

Mai  04 

1756.6 

0.769 

1.000 

0.155 

0.600 

0.737 

0.935 

0.135 

0.108 

54 

0.766 

0.046 

0.044 

0.184 

0.395 

2 

1 

2 

Api  04 

1827 

0.777 

1.000 

0.114 

0.308 

0.843 

0.966 

0.123 

0.036 

33 

0.651 

0.078 

0.048 

0.228 

0.642 

1 

1 

1 

May  04 

1669.6 

0.774 

1.000 

0.126 

0.630 

0.808 

0.955 

0.081 

0.026 

33 

0.669 

0.016 

0.028 

0.222 

0.353 

1 

2 

1 

Jim  04 

652.9 

0.773 

0.993 

0.170 

0.560 

0.616 

0.951 

0.176 

0.087 

51 

0.588 

0.026 

0.038 

0.325 

0.605 

4 

1 

1 

Jill  04 

716.4 

0.787 

0.962 

0.154 

0.516 

0.658 

0.881 

0.089 

0.093 

61 

0.530 

0.039 

0.030 

0.377 

0.886 

2 

2 

2 

Aiii|  04 

856.5 

0.932 

0.960 

0.104 

0.391 

0.582 

0.948 

0.115 

0.041 

80 

0.617 

0.043 

0.039 

0.288 

0.633 

1 

2 

1 

Sep  04 

748.5 

0.933 

0.952 

0.142 

0.435 

0.581 

0.917 

0.137 

0.056 

58 

0.582 

0.072 

0.017 

0.333 

0.895 

1 

0 

0 

Oct  04 

712.2 

0.905 

0.992 

0.106 

0.350 

0.463 

0.868 

0.124 

0.032 

78 

0.532 

0.040 

0.043 

0.351 

1.037 

1 

0 

1 

Nov  04 

654 

0.895 

0.993 

0.151 

0.393 

0.429 

0.954 

0.123 

0.043 

96 

0.445 

0.038 

0.032 

0.425 

0.778 

0 

3 

2 

Dec  04 

1240.8 

0.887 

0.993 

0.167 

0.345 

0.564 

0.965 

0.155 

0.046 

85 

0.501 

0.030 

0.051 

0.370 

0.810 

1 

0 

1 
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Dyess  AFB  j7BWj  P  ait-2 


Flight 

Mishaps 

(count) 

Ground 

Mishaps 

(count) 

STVs 

(count) 

DSVs 

(count) 

TDVs 

(count) 

DRs 

Suh 

(count) 

TO  Imp 
Suh 
(count) 

OVI 

Pass 

(rate) 

KTL 

Pass 

(rate) 

Phase 

KTL 

(rate) 

PE 

Pass 

(rate) 

1 

0 

5 

2 

1 

23 

11 

0.939 

0.886 

0.889 

1.000 

0 

1 

5 

1 

1 

24 

7 

0.949 

0.931 

0.800 

1.000 

0 

0 

5 

0 

1 

23 

4 

0.940 

0.853 

0.800 

0.976 

0 

0 

8 

3 

1 

23 

2 

0.992 

0.944 

1.000 

0 

0 

3 

0 

1 

26 

27 

0.932 

0.857 

0.907 

0 

0 

2 

1 

0 

23 

13 

0.971 

0.964 

1.000 

0.923 

0 

0 

18 

8 

1 

34 

14 

0.902 

0.864 

1.000 

1.000 

1 

1 

8 

4 

0 

21 

3 

0.865 

0.947 

1.000 

0.975 

0 

1 

14 

8 

0 

40 

14 

0.919 

0.750 

0.800 

0.941 

1 

0 

3 

1 

0 

24 

15 

0.848 

0.875 

0.889 

1.000 

0 

0 

4 

0 

0 

9 

8 

0.940 

0.917 

1.000 

1.000 

1 

0 

13 

5 

1 

20 

10 

0.768 

0.818 

0.833 

0.971 

1 

0 

9 

3 

0 

17 

4 

0.918 

0.944 

1.000 

1.000 

1 

1 

10 

4 

1 

14 

10 

0.877 

0.800 

0.800 

0.960 

1 

1 

16 

5 

0 

23 

6 

0.882 

0.867 

0.842 

0.927 

0 

1 

15 

7 

1 

31 

10 

0.883 

0.774 

0.650 

0.961 

1 

0 

11 

4 

0 

17 

5 

0.886 

0.913 

0.800 

0.984 

1 

0 

14 

4 

1 

18 

2 

0.840 

0.870 

1.000 

0.917 

1 

1 

32 

10 

3 

17 

12 

0.821 

0.833 

0.750 

0.877 

0 

1 

20 

11 

4 

8 

9 

0.768 

0.722 

0.889 

0.860 

0 

0 

48 

32 

3 

19 

0 

0.843 

0.875 

1.000 

0.946 

0 

1 

38 

20 

2 

11 

12 

0.864 

0.820 

0.906 

0.868 

2 

0 

41 

22 

5 

14 

9 

0.852 

0.659 

0.765 

0.939 

0 

1 

26 

8 

0 

5 

10 

0.888 

0.765 

0.667 

1.000 
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Appendix  AY :  Ellsworth  AFB  Data 


Ellswoith  (28BW| 

Part-1 

Flight 

Homs 

MXG 

2A2W 

Manning 

OA 

Manning 

Effect 

(rate) 

Bieak 

(late) 

Fix 

(rate) 

Flying 

Scheil 

Effect 

(rate) 

MX 

Scheil 

Effect 

(rate) 

Aboil 

(rate) 

IFE 

(late) 

MX/Ops 

Devs 

(count) 

MC 

(rate) 

Repeat 

(rate) 

Recm 

(rate) 

TNMCM 

(rate) 

CANN 

(late) 

DOPs 

(count) 

FODs 

(count) 

Combined 

Mishaps 

(count) 

J<iii  03 

738.8 

0.800 

0.261 

0.444 

0.610 

0.987 

0.139 

0.017 

40 

0.624 

0.013 

0.019 

0.284 

0.659 

1 

0 

1 

Fel.  03 

1165.1 

0.800 

0.161 

0.516 

0.746 

0.982 

0.093 

0.016 

32 

0.652 

0.027 

0.018 

0,251 

0.214 

2 

1 

0 

Mar  03 

1812.3 

0.800 

0.206 

0.667 

0.854 

1.000 

0.106 

0.004 

17 

0.769 

0.027 

0.029 

0.173 

0.251 

0 

0 

1 

Apr  03 

1774.3 

0.800 

0.167 

0.676 

0.904 

0.993 

0.053 

0.027 

11 

0.759 

0.018 

0.027 

0.178 

0.276 

1 

3 

1 

May  03 

646.8 

0.800 

0.340 

0.529 

0.676 

1.000 

0.181 

0.040 

27 

0.609 

0.011 

0.011 

0.335 

0.240 

1 

1 

1 

Jim  03 

533.7 

0.800 

0.282 

0.477 

0.651 

0.965 

0.151 

0.032 

38 

0.690 

0.020 

0.018 

0,252 

0.179 

2 

0 

0 

Jul  03 

686,4 

0.793 

0.273 

0.627 

0.721 

0.968 

0.164 

0.021 

44 

0.744 

0.024 

0.029 

0.197 

0.235 

2 

1 

1 

Aiii|  03 

572.5 

0.793 

0.225 

0.615 

0.738 

0.983 

0.155 

0.017 

33 

0.690 

0.034 

0.034 

0.214 

0.364 

2 

1 

1 

Sep  03 

979.2 

0.793 

0.240 

0.533 

0.634 

0.989 

0.090 

0.016 

24 

0.716 

0.021 

0.021 

0.187 

0.480 

0 

1 

0 

Oct  03 

1419.2 

0.793 

0.266 

0.528 

0.775 

0.991 

0.106 

0.030 

25 

0.693 

0.038 

0.063 

0.203 

0.578 

2 

1 

0 

Nov  03 

1547.9 

0.793 

0.192 

0.382 

0.751 

0.970 

0.101 

0.012 

31 

0.699 

0.018 

0.045 

0.213 

0.689 

4 

3 

0 

Dec  03 

1422.9 

0.815 

0.192 

0.783 

0.856 

0.965 

0.079 

0.008 

15 

0.749 

0.026 

0.021 

0.135 

0.833 

1 

0 

0 

Jan  04 

1576.7 

0.783 

0.793 

0.251 

0.651 

0.738 

0.978 

0.092 

0.018 

34 

0.646 

0.026 

0.024 

0.236 

0.620 

0 

0 

0 

Fel)  04 

1396.3 

0.784 

0.793 

0.244 

0.610 

0.745 

0.994 

0.124 

0.018 

37 

0.652 

0.045 

0.021 

0.223 

0.583 

3 

0 

0 

Mai  04 

704.6 

0.781 

0.793 

0.271 

0.615 

0.675 

0.986 

0.095 

0.028 

34 

0.699 

0.021 

0.018 

0.221 

0.597 

0 

0 

0 

Apt  04 

728.8 

0.832 

0.779 

0.262 

0.816 

0.764 

0.962 

0.132 

0.016 

30 

0.648 

0.013 

0.030 

0.285 

0.460 

7 

0 

0 

May  04 

661.8 

0.818 

0.815 

0.199 

0.636 

0.519 

1.000 

0.123 

0.018 

70 

0.662 

0.022 

0.011 

0.229 

0.440 

1 

0 

0 

Jim  04 

1255.5 

0.799 

0.815 

0.230 

0.541 

0.506 

0.997 

0.174 

0.031 

54 

0.649 

0.014 

0.022 

0.267 

0.708 

2 

0 

0 

Jul  04 

1489.2 

0.796 

0.815 

0.232 

0.487 

0.715 

0.987 

0.147 

0.048 

29 

0.702 

0.027 

0.025 

0.205 

0.702 

1 

1 

0 

Aui|  04 

1506.8 

0.928 

0.797 

0.237 

0.565 

0.718 

0.986 

0.087 

0.021 

34 

0.673 

0.018 

0.022 

0.230 

0.433 

1 

1 

1 

Sep  04 

1372.1 

0.924 

0.797 

0.241 

0.529 

0.780 

0.947 

0.075 

0.042 

18 

0.682 

0.047 

0.009 

0.210 

0.809 

1 

1 

1 

Oct  04 

1422.9 

0.923 

0.797 

0.202 

0.541 

0.737 

0.970 

0.084 

0.011 

31 

0.704 

0.023 

0.029 

0.191 

0.650 

1 

1 

0 

Nov  04 

1315.0 

0.913 

0.818 

0.217 

0.526 

0.731 

0.967 

0.141 

0.029 

32 

0.671 

0.029 

0.020 

0.189 

0.834 

2 

0 

0 

Dec  04 

789.7 

0.902 

0.815 

0.223 

0.667 

59.800 

0.962 

0.176 

0.025 

38 

0.734 

0.008 

0.011 

0.149 

0.711 

2 

0 

0 
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Ellsworth  (2 

BBW)  Part-2 

Flight 

Mishaps 

(count) 

Ground 

Mishaps 

(count) 

STVs 

(count) 

DSVs 

(count) 

TDVs 

(count) 

DRs 

Suh 

(count) 

TO  Imp 
Sub 
(count) 

OVI 

Pass 

(rate) 

KTL 

Pass 

(rate) 

Phase 

KTL 

(rate) 

PE 

Pass 

(rate) 

0 

1 

3 

3 

0 

6 

13 

0.940 

1.000 

1.000 

0 

0 

2 

2 

0 

0 

18 

0.940 

0.970 

0.970 

0 

1 

0 

0 

0 

30 

34 

0.970 

1.000 

0.980 

1 

0 

8 

8 

0 

42 

46 

0.930 

0.920 

1.000 

1 

0 

0 

0 

0 

7 

47 

0.940 

0.960 

1.000 

0 

0 

8 

2 

0 

3 

17 

0.950 

0.920 

0.930 

1 

0 

2 

7 

7 

20 

3 

0.930 

0.950 

1.000 

1 

0 

1 

2 

1 

11 

32 

0.940 

0.970 

1.000 

0 

0 

0 

0 

0 

14 

24 

0.980 

0.980 

1.000 

1.000 

0 

0 

0 

1 

1 

21 

11 

0.960 

0.990 

0.880 

0.990 

0 

0 

2 

0 

0 

20 

4 

0.970 

0.940 

1.000 

1.000 

0 

0 

8 

11 

2 

21 

20 

0.910 

0.940 

1.000 

1.000 

0 

0 

7 

9 

1 

17 

12 

0.940 

0.970 

0.930 

0.980 

0 

0 

8 

4 

0 

18 

3 

0.930 

0.930 

0.700 

0.980 

0 

0 

5 

4 

3 

12 

19 

0.920 

0.980 

0.850 

0.990 

0 

0 

4 

2 

3 

21 

11 

0.940 

0.890 

1.000 

0.980 

0 

0 

3 

1 

1 

12 

4 

0.950 

0.850 

0.920 

1.000 

0 

0 

2 

3 

1 

7 

8 

0.920 

0.910 

0.670 

0.920 

0 

0 

1 

2 

0 

18 

10 

0.950 

0.910 

0.800 

1.000 

1 

0 

2 

3 

5 

8 

21 

0.880 

0.920 

0.750 

1.000 

0 

1 

5 

1 

5 

14 

11 

0.890 

0.760 

0.330 

0.860 

0 

0 

2 

4 

4 

18 

7 

0.850 

0.630 

0.000 

0.980 

0 

0 

6 

9 

8 

8 

12 

0.830 

0.870 

0.600 

0.920 

0 

0 

9 

8 

2 

9 

19 

0.880 

0.700 

0.000 

0.940 
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Appendix  AZ:  Holloman  AFB  Data 


Holloman  |49FW| 

Pait-1 

Flight 

Homs 

MXG 

2A2W 

Manning 

OA 

Manning 

Effect 

(late) 

Bieak 

(late) 

Fix 

(tate) 

Flying 

Sclieil 

Effect 

(late) 

MX 

Sclieil 

Effect 

(late) 

Alton 

(tate) 

IFE 

(tate) 

MX  Ops 
Devs 
(count) 

MC 

(late) 

Repeat 

(rate) 

Recm 

(rate) 

TNMCM 

(rate) 

CANN 

(tate) 

DOPs 

(count) 

FODs 

(count) 

Combined 

Mishaps 

(count) 

Jan  03 

900.4 

1.000 

0.079 

0.805 

0.757 

0.949 

0.058 

0.010 

0.700 

0.752 

0.011 

0.016 

0.230 

0.004 

1 

0 

1 

Fell  03 

935.9 

1.000 

0.050 

0.750 

0.733 

0.785 

0.065 

0.020 

0.730 

0.772 

0.008 

0.033 

0.183 

0.007 

0 

0 

0 

Mai  03 

1259.2 

1.000 

0.085 

0.804 

0.879 

0.832 

0.061 

0.040 

0.200 

0.824 

0.006 

0.056 

0.127 

0.017 

1 

3 

1 

Api  03 

836.5 

1.000 

0.070 

0.593 

0.740 

0.841 

0.045 

0.000 

0.230 

0.845 

0.036 

0.048 

0.107 

0.018 

2 

0 

1 

May  03 

948.8 

1.000 

0.078 

0.622 

0.823 

0.919 

0.035 

0.030 

0.280 

0.806 

0.007 

0.040 

0.165 

0.003 

1 

1 

0 

Jim  03 

1049.2 

1.000 

0.069 

0.727 

0.822 

0.950 

0.035 

0.050 

0.660 

0.759 

0.042 

0.024 

0.221 

0.017 

2 

2 

0 

Jill  03 

1281.6 

1.000 

0.069 

0.809 

0.896 

0.990 

0.037 

0.090 

0.510 

0.795 

0.040 

0.050 

0.202 

0.007 

2 

5 

0 

Am)  03 

1131.7 

1.000 

0.080 

0.604 

0.779 

0.813 

0.039 

0.050 

1.050 

0.719 

0.025 

0.025 

0.252 

0.012 

0 

2 

0 

Sep  03 

958.0 

1.000 

0.067 

0.659 

0.693 

0.991 

0.045 

0.020 

0.860 

0.774 

0.013 

0.026 

0.214 

0.010 

0 

1 

1 

Oct  03 

1136.0 

1.000 

0.060 

0.643 

0.767 

0.963 

0.045 

0.120 

0.590 

0.756 

0.011 

0.039 

0.215 

0.013 

3 

0 

0 

Nov  03 

791.6 

1.000 

0.091 

0.800 

0.624 

0.912 

0.054 

0,080 

0.980 

0.744 

0.023 

0.041 

0.237 

0.018 

2 

0 

0 

Dec  03 

1023.8 

1.000 

0.086 

0.824 

0.680 

0.920 

0.042 

0.000 

1.060 

0.710 

0.036 

0.031 

0.254 

0.022 

0 

0 

0 

Jan  04 

1040.6 

0.732 

1.000 

0.089 

0.741 

0.663 

0.966 

0.055 

0.060 

1.120 

0.700 

0.035 

0.030 

0.276 

0.007 

2 

1 

0 

Fell  04 

1035.2 

0.734 

1.000 

0.102 

0.734 

0.693 

0.960 

0.061 

0.060 

0.790 

0.725 

0.025 

0.030 

0.244 

0.016 

1 

2 

1 

Mai  04 

1203.6 

0.756 

1.000 

0.081 

0.710 

0.758 

0.972 

0.029 

0.070 

0.640 

0.763 

0.017 

0.023 

0.210 

0.026 

1 

0 

0 

Apr  04 

1316.7 

0.823 

1.000 

0.063 

0.784 

0.746 

0.972 

0.035 

0.080 

0.960 

0.754 

0.030 

0.042 

0.223 

0.012 

0 

0 

0 

May  04 

971.0 

0.850 

1.000 

0.079 

0.820 

0.836 

0.953 

0.052 

0.080 

0.510 

0.777 

0.007 

0.041 

0.193 

0.027 

0 

1 

1 

Jim  04 

859.1 

0.833 

1.000 

0.099 

0.630 

0.665 

0.960 

0.069 

0.060 

0.820 

0.712 

0.028 

0.028 

0.261 

0.013 

1 

0 

0 

Jill  04 

977.6 

0.829 

1.000 

0.073 

0.864 

0.663 

0.960 

0.054 

0.050 

0.620 

0.818 

0.052 

0.065 

0.158 

0.013 

1 

0 

1 

Aui|  04 

883.4 

0.878 

1.000 

0.095 

0.742 

0.709 

0.948 

0.068 

0.130 

1.200 

0.770 

0.021 

0.026 

0.186 

0.020 

2 

0 

1 

Sep  04 

674.6 

0.876 

1.000 

0.097 

0.822 

0.821 

0.966 

0.055 

0.040 

0.570 

0.807 

0.045 

0.023 

0.157 

0.045 

1 

1 

0 

Oct  04 

641.5 

0.878 

1.000 

0.090 

0.667 

0.682 

0.977 

0.063 

0.030 

0.520 

0.776 

0.009 

0.018 

0.200 

0.018 

0 

0 

0 

Nov  04 

633.4 

0.865 

1.000 

0.105 

0.545 

0.723 

0.985 

0.092 

0.090 

0.540 

0.732 

0.063 

0.056 

0.239 

0.010 

0 

0 

0 

Dec  04 

907.9 

0.865 

1.000 

0.116 

0.758 

0.683 

0.928 

0.054 

0.070 

2.030 

0.611 

0.020 

0.015 

0.364 

0.015 

0 

0 

0 
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Holloman  (49FW)  Part-2 


Flight 

Mishaps 

(count) 

Ground 

Mishaps 

(count) 

STVs 

(count) 

DSVs 

(count) 

TDVs 

(count) 

DRs 

Sub 

(count) 

TO  Imp 
Sub 
(count) 

QVI 

Pass 

(rate) 

KTL 

Pass 

(rate) 

Phase 

KTL 

(rate) 

PE 

Pass 

(rate) 

1 

0 

4 

4 

0 

11 

9 

0.896 

0.921 

1.000 

0.970 

0 

0 

16 

1 

1 

6 

7 

0.944 

0.846 

0.000 

1.000 

0 

1 

14 

0 

0 

6 

16 

0.890 

1.000 

1.000 

0 

1 

19 

3 

0 

19 

13 

0.833 

0.833 

1.000 

0 

0 

32 

0 

4 

5 

4 

0.897 

0.941 

1.000 

1.000 

0 

0 

11 

1 

2 

2 

23 

0.878 

0.885 

0.500 

0.967 

0 

0 

18 

2 

3 

13 

16 

0.908 

0.936 

1.000 

1.000 

0 

0 

31 

2 

7 

14 

14 

0.917 

0.846 

1.000 

1.000 

1 

0 

17 

2 

1 

12 

25 

0.916 

0.936 

1.000 

1.000 

0 

0 

25 

3 

2 

7 

44 

0.834 

0.762 

0.800 

0.976 

0 

0 

20 

2 

2 

12 

4 

0.870 

0.727 

0.333 

0.921 

0 

0 

19 

0 

5 

15 

10 

0.873 

0.771 

0.750 

0.944 

0 

0 

21 

2 

2 

4 

10 

0.847 

0.876 

0.833 

1.000 

0 

1 

20 

0 

3 

4 

14 

0.918 

0.818 

0.250 

1.000 

0 

0 

15 

2 

3 

7 

19 

0.928 

0.889 

1.000 

1.000 

0 

0 

12 

1 

5 

13 

16 

0.915 

0.865 

0.750 

0.987 

0 

1 

5 

2 

1 

8 

20 

0.926 

0.889 

0.667 

0.984 

0 

0 

18 

2 

2 

11 

35 

0.849 

0.889 

1.000 

1.000 

0 

1 

15 

2 

0 

11 

14 

0.816 

0.818 

0.000 

1.000 

1 

0 

23 

3 

0 

10 

44 

0.827 

0.790 

0.500 

1.000 

0 

0 

12 

2 

1 

7 

17 

0.830 

0.805 

0.500 

1.000 

0 

0 

28 

6 

6 

9 

3 

0.791 

0.771 

0.750 

0.967 

0 

0 

20 

4 

4 

0 

29 

0.859 

0.462 

0.000 

0.895 

0 

0 

22 

3 

0 

11 

9 

0.878 

0.744 

1.000 

0.952 
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Appendix  BA:  Langley  AFB  Data 


Lanqley  (1FW|  Part-1 

Flight 

Homs 

MXG 

2A2W 

Manning 

OA 

Manning 

Effect 

(rate) 

Bieak 

(late) 

Fix 

(late) 

Flying 

Scheil 

Effect 

(tate) 

MX 

Scheil 

Effect 

(rate) 

Aboit 

(tate) 

IFE 

(tate) 

MX/Ops 

Devs 

(count) 

MC 

(tate) 

Repeat 

(tate) 

Recui 

(tate) 

TNMCM 

(tate) 

CANN 

(tate) 

DOPs 

(count) 

FODs 

(count) 

Combined 

Mishaps 

(count) 

J>in  03 

1360.0 

0.855 

0.176 

0.568 

0.552 

0.963 

0.095 

0.0000 

74 

0.799 

0.022 

0.019 

0.153 

0.137 

0 

3 

0 

Feb  03 

1179.9 

0.855 

0.197 

0.536 

0.527 

0.982 

0.087 

0.0000 

73 

0.785 

0.017 

0.017 

0.151 

0.123 

1 

1 

0 

Ivlar  03 

2316.2 

0.855 

0.162 

0.567 

0.729 

0.961 

0.056 

0.0000 

57 

0.837 

0.013 

0.013 

0.118 

0.174 

2 

1 

0 

A|)i  03 

2003.0 

0.855 

0.151 

0.703 

0.765 

0.980 

0.070 

0.0000 

64 

0.844 

0.006 

0.011 

0.113 

0.124 

4 

6 

0 

May  03 

1618.3 

0.855 

0.112 

0.550 

0.793 

0.982 

0.071 

0.0016 

55 

0.831 

0.022 

0.021 

0.131 

0.075 

0 

0 

0 

Jun  03 

1787.8 

0.855 

0.087 

0.669 

0.894 

0.996 

0.054 

0.0000 

47 

0.853 

0.011 

0.016 

0.115 

0.059 

2 

1 

0 

Jill  03 

1889.8 

0.855 

0.120 

0.509 

0.762 

0.969 

0.062 

0.0000 

96 

0.849 

0.007 

0.017 

0.133 

0.071 

1 

1 

1 

Aiii|  03 

1622.4 

0.855 

0.122 

0.549 

0.825 

0.972 

0.039 

0.0021 

74 

0.819 

0.017 

0.023 

0.149 

0.100 

1 

1 

0 

Sep  03 

870.3 

0.855 

0.137 

0.527 

0.459 

0.908 

0.061 

0.0011 

26 

0.852 

0.009 

0.022 

0.119 

0.144 

1 

1 

0 

Oct  03 

2021.8 

0.855 

0.137 

0.615 

0.800 

0.929 

0.072 

0.0000 

89 

0.807 

0.004 

0.017 

0.162 

0.079 

4 

2 

0 

Nov  03 

1353.2 

0.855 

0.096 

0.567 

0.900 

0.945 

0.052 

0.0000 

46 

0.849 

0.004 

0.002 

0.117 

0.080 

0 

0 

1 

Dec  03 

1551.7 

0.855 

0.167 

0.678 

0.733 

0.872 

0.088 

0.0036 

93 

0.831 

0.022 

0.029 

0.135 

0.081 

3 

3 

0 

Jan  04 

1553.9 

0.838 

0.855 

0.123 

0.625 

0.811 

0.906 

0.054 

0.0009 

52 

0.862 

0.031 

0.023 

0.103 

0.061 

6 

2 

0 

Feb  04 

1614.2 

0.840 

0.855 

0.115 

0.685 

0.845 

0.929 

0.062 

0.0040 

53 

0.816 

0.019 

0.035 

0.145 

0.098 

5 

6 

0 

M, ii  04 

2012.0 

0.840 

0.855 

0.134 

0.624 

0.824 

0.937 

0.051 

0.0014 

62 

0.828 

0.041 

0.046 

0.129 

0.088 

2 

0 

1 

Api  04 

2011.4 

0.843 

0.855 

0.126 

0.683 

0.844 

0.937 

0.058 

0.0000 

86 

0.821 

0.019 

0.041 

0.136 

0.045 

5 

3 

0 

May  04 

1468.0 

0.853 

0.855 

0.118 

0.545 

0.795 

0.952 

0.070 

0.0023 

136 

0.823 

0.017 

0.023 

0.133 

0.079 

4 

2 

0 

Jim  04 

2191.2 

0,854 

0.855 

0.125 

0.669 

0.781 

0.950 

0.054 

0.0000 

63 

0.797 

0.034 

0.037 

0.150 

0.089 

4 

2 

0 

Jill  04 

1746.2 

0.854 

0.839 

0.141 

0.639 

0.791 

0.996 

0.059 

0.0027 

62 

0.798 

0.033 

0.023 

0.163 

0.109 

2 

0 

0 

Aiii|  04 

1795.7 

0.907 

0.839 

0.127 

0.612 

0.669 

0.988 

0.072 

0.0007 

62 

0.784 

0.016 

0.036 

0.179 

0.140 

4 

0 

0 

Sep  04 

1051.3 

0.911 

0.839 

0.128 

0.750 

0.783 

0.984 

0.075 

0.0019 

44 

0.838 

0.019 

0.027 

0.120 

0.152 

2 

1 

2 

Oct  04 

1485.2 

0.909 

0.871 

0.115 

0.635 

0.818 

0.989 

0.057 

0.0033 

90 

0.776 

0.022 

0.043 

0.174 

0.058 

3 

0 

0 

Nov  04 

1130.2 

0.895 

0.871 

0.161 

0.676 

0.795 

0.966 

0.064 

0.0025 

62 

0.819 

0.014 

0.018 

0.139 

0.083 

4 

1 

0 

Dec  04 

1095.5 

0.890 

0.871 

0.183 

0.691 

0.844 

0.984 

0.067 

0.0020 

62 

0.859 

0.012 

0.014 

0.115 

0.065 

1 

0 

0 
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Langley  (1 

FW)  Part-2 

Flight 

Misluips 

(count) 

Ground 

Mishaps 

(count) 

STVs 

(count) 

DSVs 

(count) 

TDVs 

(count) 

DRs 

Sul) 

(count) 

TO 

Imp 

Suh 

(count) 

OVI 

Pass 

(rate) 

KTL 

Pass 

(rate) 

Phase 

KTL 

(rate) 

PE 

Pass 

(rate) 

0 

0 

13 

1 

5 

5 

8 

0.920 

0.870 

1.000 

1.000 

0 

0 

9 

3 

2 

12 

1 

0.930 

0.870 

0.600 

1.000 

0 

0 

2 

0 

1 

18 

3 

0.940 

0.860 

1.000 

1.000 

0 

0 

4 

0 

1 

17 

2 

0.890 

0.870 

1.000 

1.000 

0 

0 

14 

3 

6 

19 

3 

0.890 

0.880 

0.710 

1.000 

0 

0 

15 

4 

4 

19 

17 

0.880 

0.860 

0.420 

1.000 

1 

0 

11 

1 

1 

16 

5 

0.900 

0.880 

0.710 

1.000 

0 

0 

12 

1 

0 

12 

3 

0.920 

0.920 

0.600 

1.000 

0 

0 

4 

2 

1 

14 

3 

0.920 

0.950 

1.000 

1.000 

0 

0 

12 

1 

1 

21 

3 

0.910 

0.930 

0.670 

1.000 

0 

1 

11 

1 

4 

19 

0 

0.900 

0.850 

0.750 

1.000 

0 

0 

3 

0 

2 

22 

6 

0.930 

0.870 

0.710 

1.000 

0 

0 

5 

2 

0 

35 

1 

0.920 

0.880 

0.710 

0.980 

0 

0 

8 

3 

1 

28 

4 

0.920 

0.890 

0.430 

0.980 

0 

1 

5 

1 

2 

43 

8 

0.940 

0.860 

0.750 

0.980 

0 

0 

2 

2 

0 

12 

1 

0.930 

0.860 

0.500 

0.980 

0 

0 

10 

2 

1 

18 

6 

0.920 

0.910 

0.670 

0.960 

0 

0 

8 

0 

4 

20 

7 

0.940 

0.840 

0.500 

0.950 

0 

0 

14 

2 

7 

17 

10 

0.900 

0.830 

0.330 

0.950 

0 

0 

12 

1 

2 

14 

1 

0.920 

0.880 

0.330 

0.990 

2 

0 

12 

4 

4 

30 

2 

0.920 

0.840 

0.500 

1.000 

0 

0 

29 

3 

9 

18 

3 

0.900 

0.850 

0.670 

0.980 

0 

0 

18 

10 

1 

12 

7 

0.910 

0.860 

0.670 

0.970 

0 

0 

9 

3 

2 

17 

3 

0.930 

0.870 

0.670 

1.000 
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Appendix  BB:  Minot  AFB  Data 


Minot 

5BW)  Pait-1 

Flight 

Homs 

MX6 

2A2W 

Manning 

OA 

Manning 

Effect 

(rate) 

Break 

(rate) 

Fix 

(rate) 

Flying 

Sclieil 

Effect 

(rate) 

MX 

Sclierl 

Effect 

(rate) 

Alioit 

(rate) 

IFE 

(rate) 

MX  Ops 
Devs 
(count) 

MC 

(late) 

Repeat 

(rate) 

Recur 

(rate) 

TNMCM 

(rate) 

CANN 

(rate) 

DOPs 

(count) 

FODs 

(count) 

Combined 

Mishaps 

(count) 

J.111 03 

615.3 

0.884 

57.6 

0.653 

0.557 

0.975 

0.067 

0.012 

23 

0.740 

0.045 

0.062 

0.186 

0.447 

0 

14 

1 

Fell  03 

433.6 

0.884 

53.3 

0.625 

0.557 

0.975 

0.063 

0.013 

19 

0.801 

0.038 

0.022 

0.134 

0.640 

0 

14 

0 

Mar  03 

1077.6 

0.884 

83.2 

0.582 

0.827 

0.916 

0.050 

0.032 

10 

0.723 

0.024 

0.024 

0.198 

0.863 

0 

7 

0 

Apr  03 

1231.5 

0.884 

62.7 

0.580 

0.956 

1.000 

0.009 

0.027 

0 

0.698 

0.053 

0.088 

0.206 

0.609 

0 

7 

1 

May  03 

297.0 

0.884 

56.9 

0.759 

0.643 

0.955 

0.105 

0.000 

16 

0.832 

0.030 

0.022 

0.111 

0.745 

0 

4 

0 

Jim  03 

387.6 

0.884 

74.2 

0.717 

0.677 

1.000 

0.091 

0.048 

19 

0.850 

0.042 

0.032 

0.081 

0.403 

2 

14 

0 

Jnl  03 

474.5 

0.884 

57.4 

0.795 

0.623 

0.989 

0.058 

0.015 

21 

0.835 

0.022 

0.046 

0.103 

0.765 

1 

5 

0 

Aug  03 

534.9 

0.884 

63.6 

0.673 

0.526 

0.979 

0.051 

0.065 

18 

0.868 

0.045 

0.051 

0.072 

0.584 

3 

4 

0 

Sep  03 

326.5 

0.884 

53.7 

0.621 

0.717 

0.966 

0.053 

0.000 

6 

0.826 

0.040 

0.075 

0.106 

0.981 

0 

8 

0 

Oct  03 

93.1 

0.884 

75.4 

0.596 

0.551 

0.931 

0.000 

0.043 

22 

0.800 

0.039 

0.067 

0.130 

0.623 

0 

12 

0 

Nov  03 

97.7 

0.884 

67.2 

0.585 

0.600 

0.977 

0.077 

0.000 

13 

0.767 

0.045 

0.030 

0.115 

0.443 

1 

7 

0 

Dec  03 

95.8 

0.884 

71.0 

0.682 

0.449 

0.958 

0.090 

0.016 

23 

0.848 

0.054 

0.060 

0.116 

0.516 

1 

11 

0 

Jan  04 

96.0 

0.790 

0.940 

60.8 

0.710 

0.319 

0.960 

0.121 

0.000 

25 

0.845 

0.036 

0.065 

0.104 

0.353 

0 

6 

1 

Feb  04 

94.3 

0.815 

0.940 

64.5 

0.550 

0.294 

0.943 

0.046 

0.048 

31 

0.754 

0.037 

0.034 

0.154 

0.387 

0 

5 

0 

Mai  04 

100.0 

0.847 

0.940 

70.7 

0.759 

0.470 

1.000 

0.080 

0.012 

31 

0.763 

0.036 

0.036 

0.130 

0.293 

1 

5 

0 

Apr  04 

98.4 

0.876 

0.940 

56.8 

0.761 

0.266 

0.984 

0.069 

0.000 

29 

0.742 

0.044 

0.039 

0.128 

0.346 

0 

5 

0 

May  04 

98.7 

0.868 

0.940 

39.4 

0.714 

0.486 

0.987 

0.066 

0.028 

26 

0.805 

0.024 

0.034 

0,115 

0.394 

0 

3 

0 

Jim  04 

96.5 

0.886 

0.940 

60.0 

0.636 

0.527 

0.965 

0.068 

0.073 

17 

0.836 

0.017 

0.031 

0.103 

0.382 

1 

5 

0 

Jul  04 

98.1 

0.871 

0.940 

61.0 

0.617 

0.470 

0.981 

0.105 

0.013 

33 

0.781 

0.059 

0.046 

0.147 

0.442 

0 

10 

0 

Aii(|  04 

97.3 

0.804 

0.940 

64.7 

0.659 

0.486 

0.973 

0,093 

0.015 

26 

0.800 

0.020 

0.062 

0.125 

0.544 

2 

4 

2 

Sep  04 

94.9 

0.870 

0.890 

67.7 

0.738 

0.578 

0.949 

0.062 

0.048 

17 

0.818 

0.014 

0.054 

0.121 

0.452 

0 

9 

1 

Oct  04 

333.9 

0.870 

0.912 

67.9 

0.737 

0.724 

0.955 

0.141 

0.036 

14 

0.800 

0.031 

0.031 

0.134 

0.696 

1 

12 

0 

Nov  04 

426.8 

0.864 

0.912 

75.0 

0.756 

0.565 

0.959 

0.118 

0.000 

25 

0.821 

0.039 

0.034 

0.103 

0.433 

1 

15 

0 

Dec  04 

392.4 

0.887 

0.912 

65.1 

0.659 

0.460 

0.935 

0.075 

0.000 

30 

0.778 

0.025 

0.015 

0.135 

0.571 

0 

13 

0 
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Minot  (5BW)  Part-2 


Flight 

Mishaps 

(count) 

Ground 

Mishaps 

(count) 

STVs 

(count) 

DSVs 

(count) 

TDVs 

(count) 

DRs  Sub 
(count) 

TO  Imp 
Sub 
(count) 

QVI 

Pass 

(rate) 

KTL 

Pass 

(rate) 

Phase 

KTL 

(rate) 

PE  Pass 
(rate) 

1 

0 

6 

2 

1 

8 

5 

0.928 

1.000 

0.810 

0.970 

0 

0 

6 

2 

0 

14 

2 

0.876 

1.000 

0.571 

1.000 

0 

0 

5 

0 

1 

6 

5 

0.932 

1.000 

0.777 

1.000 

1 

0 

2 

2 

0 

15 

6 

0.934 

1.000 

0.881 

0.985 

0 

0 

10 

6 

2 

6 

2 

0.881 

1.000 

0.800 

1.000 

0 

0 

4 

1 

0 

9 

8 

0.942 

1.000 

0.881 

1.000 

0 

0 

11 

3 

1 

19 

6 

0.921 

1.000 

0.700 

0.971 

0 

0 

8 

5 

1 

9 

4 

0.878 

1.000 

0.700 

0.992 

0 

0 

2 

0 

0 

6 

3 

0.927 

1.000 

0.897 

0.976 

0 

0 

8 

3 

0 

19 

3 

0.869 

1.000 

0.857 

0.986 

0 

0 

19 

9 

0 

28 

4 

0.944 

1.000 

0.947 

1.000 

0 

0 

12 

5 

1 

16 

7 

0.957 

0.933 

0.957 

0.975 

0 

1 

9 

3 

0 

22 

4 

0.857 

1.000 

0.619 

0.967 

0 

0 

7 

5 

1 

11 

4 

0.904 

0.929 

0.909 

1.000 

0 

0 

4 

0 

1 

21 

7 

0.976 

1.000 

0.933 

1.000 

0 

0 

1 

1 

0 

31 

5 

0.916 

1.000 

0.857 

0.992 

0 

0 

1 

0 

0 

20 

0 

0.919 

1.000 

1.000 

0 

0 

4 

1 

0 

8 

5 

0.934 

1.000 

0.925 

1.000 

0 

0 

2 

1 

0 

7 

1 

0.921 

1.000 

0.750 

1.000 

1 

1 

10 

7 

0 

20 

7 

0.960 

1.000 

0.909 

0.987 

0 

1 

4 

3 

0 

10 

8 

0.971 

1.000 

0.909 

1.000 

0 

0 

3 

0 

0 

21 

4 

0.959 

1.000 

0.869 

0.985 

0 

0 

2 

1 

0 

18 

4 

0.955 

0.875 

0.864 

0.991 

0 

0 

9 

2 

0 

13 

1 

0.957 

1.000 

0.952 

1.000 
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Appendix  BC:  Mountain  Home  AFB  Data 


Mountain  Home  |366FW|  Pait-1 


Flight  Hours 

MXG 2A2W 
Manning 

OA 

Manning 

Effect 

(rate) 

Bieak  (rate) 

Fix  (rate) 

Flying  Sclie 
(rate 

d  Effect 

F-15C 

F-15E 

F-16  |50) 

F-15C 

F-15E 

F-16  (50) 

F-15C 

F-15E 

F-16  (50) 

F-15C 

F-15E 

F-16  (50) 

Jan  03 

389.4 

432.7 

351.4 

0.860 

0.186 

0.151 

0.081 

0.737 

0.702 

0.636 

0.707 

0.712 

0.631 

Feb  03 

914.5 

568.5 

337.4 

0.860 

0.247 

0.157 

0.068 

0.727 

0.855 

0.667 

0.596 

0.883 

0.669 

Mar  03 

462.8 

504.2 

335.8 

0.831 

0.156 

0.114 

0.105 

0.846 

0.683 

0.815 

0.892 

0.804 

0.823 

Api  03 

465.8 

583.1 

315.4 

0.831 

0.153 

0.123 

0.068 

0.833 

0.563 

0.600 

0.739 

0.796 

0.770 

May  03 

397.2 

557.2 

313.5 

0.831 

0.095 

0.154 

0.090 

0.692 

0.574 

0.652 

0.744 

0.700 

0.691 

Jim  03 

386.4 

686.1 

345.3 

0.820 

0.124 

0.173 

0.049 

0.595 

0.629 

0.786 

0.758 

0.819 

0.763 

Jul  03 

405.0 

696.9 

357.8 

0.820 

0.148 

0.180 

0.101 

0.500 

0.658 

0.643 

0.733 

0.680 

0.779 

Aik|  03 

409.6 

542.2 

306.2 

0.820 

0.172 

0.229 

0.100 

0.623 

0.654 

0.667 

0.736 

0.617 

0.670 

Sep  03 

337.5 

570.3 

397.9 

0.820 

0.164 

0.154 

0.067 

0.766 

0.684 

0.714 

0.843 

0.705 

0.823 

Oct  03 

375.8 

559.2 

398.8 

0.820 

0.170 

0.126 

0.070 

0.696 

0.574 

0.600 

0.734 

0.700 

0.782 

Nov  03 

352.2 

507.4 

324.0 

0.841 

0.170 

0.147 

0.054 

0.625 

0.692 

0.857 

0.758 

0.684 

0.748 

Dec  03 

333.3 

1432.0 

348.5 

0.841 

0.155 

0.244 

0.061 

0.778 

0.721 

0.750 

0.689 

0.832 

0.726 

Jan  04 

374.8 

1494.5 

290.2 

0.740 

0.841 

0.094 

0.164 

0.102 

0.727 

0.800 

0.864 

0.718 

0.709 

0.410 

Feb  04 

433.8 

1604.6 

509.9 

0.760 

0.841 

0.131 

0.152 

0.067 

0.784 

0.813 

0.731 

0.735 

0.780 

0.795 

Mar  04 

497.5 

991.9 

608.9 

0.757 

0.841 

0.093 

0.128 

0.083 

0.711 

0.698 

0.903 

0.878 

0.739 

0.821 

Apr  04 

356.4 

606.0 

408.0 

0.753 

0.841 

0.127 

0.146 

0.083 

0.705 

0.758 

0.880 

0.824 

0.803 

0.792 

May  04 

512.4 

511.4 

468.1 

0.763 

0.841 

0.158 

0.124 

0.036 

0.755 

0.773 

1.000 

0.745 

0.858 

0.703 

Jun  04 

536.0 

710.4 

469.1 

0.756 

0.841 

0.128 

0.131 

0.059 

0.689 

0.732 

0.818 

0.818 

0.898 

0.822 

Jul  04 

274.3 

529.0 

411.0 

0.761 

0.841 

0.108 

0.131 

0.082 

0.688 

0.674 

0.741 

0.793 

0.893 

0.686 

Ami  04 

349.2 

621.2 

430.9 

0.859 

0.841 

0.126 

0.104 

0.043 

0.774 

0.805 

0.733 

0.644 

0.785 

0.585 

Sep  04 

218.0 

426.7 

382.4 

0.852 

0.841 

0.175 

0.079 

0.064 

0.714 

0.877 

0.769 

0.755 

0.782 

0.833 

Oct  04 

400.3 

487.1 

261.7 

0.844 

0.822 

0.115 

0.149 

0.069 

0.742 

0.680 

0.733 

0.840 

0.823 

0.883 

Nov  04 

225.4 

450.7 

148.5 

0.829 

0.815 

0.251 

0.117 

0.021 

0.551 

0.750 

1.000 

0.787 

0.840 

0.919 

Dec  04 

348.6 

489.2 

256.0 

0.821 

0.815 

0.174 

0.122 

0.075 

0.704 

0.760 

0.688 

0.835 

0.819 

0.879 
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Mountain  Home  (366FW)  Part-2 


MX  Sched  Effect 
(rate) 

Abort  (rate) 

IFE  (rate) 

i 

o 

ps  Devs  (count) 

MC  (rate) 

F-15C 

F-15E 

F-16  50 

F-15C 

F-15E 

F-16  50) 

F-15C 

F-15E 

F-16  (50 

F-15C 

F-15E 

F-16  50  |  F-15C 

F-15E 

F-16  50 

0.950 

0.963 

0.976 

0.067 

0.097 

0.065 

0.003 

0.013 

0.007 

17 

24 

20 

0.741 

0.792 

0.587 

0.958 

0.989 

0.992 

0.083 

0.081 

0.064 

0.000 

0.005 

0.009 

7 

28 

29 

0.700 

0.803 

0.740 

0.982 

0.958 

0.992 

0.046 

0.075 

0.041 

0.003 

0.003 

0.000 

17 

24 

20 

0.700 

0.766 

0.751 

0.978 

0.978 

0.950 

0.038 

0.083 

0.060 

0.011 

0.013 

0.000 

45 

23 

10 

0.692 

0.802 

0.771 

0.982 

0.967 

0.982 

0.049 

0.072 

0.056 

0.011 

0.008 

0.004 

30 

61 

23 

0.617 

0.755 

0.766 

0.986 

0.972 

0.989 

0.064 

0.094 

0.056 

0.012 

0.011 

0.018 

41 

30 

14 

0.630 

0.778 

0.864 

0.962 

0.967 

0.966 

0.058 

0.105 

0.045 

0.013 

0.010 

0.018 

36 

84 

28 

0.717 

0.750 

0.756 

1.000 

0.992 

1.000 

0.064 

0.118 

0.032 

0.026 

0.018 

0.000 

16 

56 

29 

0.725 

0.741 

0.770 

0.972 

0.949 

0.969 

0.060 

0.076 

0.055 

0.007 

0.005 

0.006 

18 

49 

21 

0.708 

0.695 

0.770 

0.984 

0.979 

0.996 

0.052 

0.088 

0.066 

0.004 

0.005 

0.014 

35 

61 

15 

0.707 

0.722 

0.842 

0.965 

0.984 

1.000 

0.041 

0.068 

0.062 

0.032 

0.006 

0.004 

35 

59 

9 

0.660 

0.727 

0.869 

0.968 

0.992 

0.981 

0.079 

0.049 

0.044 

0.017 

0.003 

0.004 

24 

14 

7 

0.856 

0.799 

0.887 

0.992 

1.000 

1.000 

0.049 

0.071 

0.077 

0.004 

0.000 

0.000 

13 

16 

9 

0.847 

0.790 

0.887 

0.994 

0.986 

1.000 

0.054 

0.076 

0.051 

0.004 

0.007 

0.000 

20 

28 

13 

0.730 

0.784 

0.879 

0.989 

0.958 

0.995 

0.035 

0.095 

0.053 

0.005 

0.006 

0.003 

30 

34 

17 

0.766 

0.850 

0.872 

0.996 

0.994 

0.981 

0.052 

0.061 

0.047 

0.003 

0.005 

0.007 

40 

21 

9 

0.795 

0.855 

0.896 

0.971 

0.997 

1.000 

0.086 

0.085 

0.066 

0.006 

0.006 

0.000 

41 

23 

11 

0.786 

0.885 

0.871 

0.994 

0.992 

1.000 

0.056 

0.062 

0.031 

0.003 

0.013 

0.000 

12 

20 

7 

0.799 

0.841 

0.883 

0.984 

0.990 

1.000 

0.051 

0.064 

0.050 

0.007 

0.006 

0.000 

27 

24 

16 

0.814 

0.828 

0.878 

0.972 

0.995 

1.000 

0.075 

0.107 

0.042 

0.024 

0.008 

0.000 

33 

39 

23 

0.869 

0.845 

0.868 

0.995 

1.000 

1.000 

0.061 

0.102 

0.033 

0.015 

0.003 

0.005 

21 

26 

7 

0.827 

0.850 

0.882 

0.992 

1.000 

1.000 

0.066 

0.120 

0.031 

0.000 

0.015 

0.009 

11 

30 

18 

0.860 

0.863 

0.855 

0.981 

0.995 

1.000 

0.118 

0.103 

0.030 

0.021 

0.006 

0.017 

33 

28 

8 

0.697 

0.838 

0.822 

0.973 

1.000 

0.996 

0.046 

0.067 

0.058 

0.010 

0.005 

0.000 

43 

46 

18 

0.863 

0.861 

0.791 
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Mountain  Home  |366FW)  Pait-3 


Repeat 

late) 

Recur  (rate) 

Th 

MCM 

rate) 

CANN  (tate) 

DOPs 

(count) 

FODs 

(count) 

Combined 

Mishaps 

(count) 

Flight 

Mishaps 

(count) 

Giournl 

Mishaps 

(count) 

F-15C 

F-15E 

F-16  (50) 

F-15C 

F-15E 

F-16  (50) 

F-15C 

F-15E 

F-16  (50) 

F-15C 

F-15E 

F-16  50) 

0.031 

0.014 

0.015 

0.024 

0.036 

0.031 

0.194 

0.148 

0.351 

0.147 

0.219 

0.205 

3 

3 

1 

1 

0 

0.000 

0.009 

0.010 

0.013 

0.038 

0.061 

0.212 

0.147 

0.173 

0.197 

0.136 

0.119 

2 

1 

1 

0 

1 

0.003 

0.019 

0.033 

0.000 

0.028 

0.082 

0.197 

0.148 

0.104 

0.120 

0.122 

0.098 

0 

4 

1 

0 

0 

0.009 

0.022 

0.010 

0.017 

0.045 

0.039 

0.224 

0.144 

0.113 

0.088 

0.126 

0.123 

1 

2 

1 

1 

1 

0.000 

0.009 

0.034 

0.008 

0.033 

0.042 

0.248 

0.153 

0.113 

0.121 

0.063 

0.153 

1 

5 

0 

0 

0 

0.006 

0.013 

0.018 

0.012 

0.032 

0.009 

0.218 

0.160 

0.050 

0.103 

0.086 

0.157 

3 

0 

0 

0 

0 

0.024 

0.019 

0.033 

0.045 

0.038 

0.024 

0.216 

0.190 

0.129 

0.145 

0.200 

0.157 

0 

3 

0 

0 

0 

0.034 

0.077 

0.038 

0.021 

0.036 

0.077 

0.190 

0.172 

0.124 

0.113 

0.174 

0.225 

2 

2 

1 

0 

1 

0.011 

0.026 

0.051 

0.019 

0.023 

0.058 

0.198 

0.198 

0.094 

0.213 

0.152 

0.099 

0 

4 

1 

0 

0 

0.014 

0.028 

0.015 

0.032 

0.031 

0.036 

0.178 

0.202 

0.093 

0.151 

0.139 

0.126 

2 

1 

1 

0 

0 

0.014 

0.018 

0.019 

0.042 

0.021 

0.010 

0.239 

0.209 

0.070 

0.272 

0.297 

0.112 

1 

1 

0 

0 

0 

0.009 

0.011 

0.000 

0.031 

0.017 

0.034 

0.104 

0.128 

0.057 

0.206 

0.085 

0.126 

1 

3 

0 

0 

0 

0.005 

0.022 

0.018 

0.037 

0.014 

0.009 

0.091 

0.121 

0.050 

0.176 

0.123 

0.144 

1 

2 

1 

0 

1 

0.009 

0.010 

0.012 

0.030 

0.015 

0.019 

0.149 

0.106 

0.071 

0.220 

0.071 

0.069 

1 

0 

3 

0 

2 

0.011 

0.008 

0.027 

0.043 

0.016 

0.007 

0.164 

0.082 

0.058 

0.110 

0.137 

0.096 

1 

2 

1 

0 

1 

0.008 

0.018 

0.017 

0.033 

0.028 

0.000 

0.122 

0.087 

0.041 

0.107 

0.142 

0.066 

1 

1 

0 

0 

0 

0.000 

0.047 

0.012 

0.040 

0.030 

0.000 

0.132 

0.081 

0.063 

0.113 

0.142 

0.116 

4 

4 

0 

0 

0 

0.018 

0.020 

0.009 

0.004 

0.028 

0.026 

0.121 

0.113 

0.038 

0.091 

0.118 

0.043 

1 

1 

1 

0 

0 

0.021 

0.015 

0.021 

0.038 

0.015 

0.007 

0.114 

0.103 

0.056 

0.125 

0.168 

0.027 

2 

2 

2 

0 

2 

0.008 

0.014 

0.009 

0.050 

0.018 

0.000 

0.080 

0.099 

0.033 

0.113 

0.180 

0.035 

0 

3 

2 

1 

0 

0.012 

0.013 

0.000 

0.028 

0.020 

0.015 

0.106 

0.091 

0.069 

0.220 

0.253 

0.025 

1 

2 

1 

0 

1 

0.008 

0.010 

0.026 

0.032 

0.013 

0.027 

0.087 

0.084 

0.061 

0.130 

0.140 

0.078 

3 

1 

1 

0 

1 

0.014 

0.004 

0.000 

0.018 

0.011 

0.040 

0.227 

0.116 

0.076 

0.185 

0.184 

0.036 

0 

0 

0 

0 

0 

0.003 

0.013 

0.040 

0.023 

0.019 

0.053 

0.137 

0.081 

0.099 

0.096 

0.262 

0.075 

1 

0 

4 

0 

0 
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Mountain  Home  (366 

:W)  Part-' 

STVs 

(count) 

DSVs 

(count) 

TDVs 

(count) 

DRs 

Sub 

(count) 

TO  Imp 
Sub 
(count) 

QVI  Pass 
(rate) 

KTL 

Pass 

(rate) 

Phase 

KTL 

(rate) 

PE 

Pass 

(rate) 

35 

19 

22 

21 

19 

7 

21 

13 

26 

3 

30 

18 

56 

12 

36 

11 

0.900 

31 

8 

0.900 

30 

12 

0.910 

9 

5 

3 

20 

25 

0.890 

3 

2 

0 

18 

6 

0.900 

6 

3 

0 

15 

7 

0.900 

0.840 

0.850 

0.850 

16 

6 

8 

24 

17 

0.920 

0.960 

0.940 

0.940 

4 

0 

3 

30 

12 

0.930 

0.960 

0.930 

0.930 

3 

0 

1 

29 

25 

0.900 

0.910 

1.000 

1.000 

16 

7 

6 

22 

17 

0.890 

0.980 

0.910 

0.910 

20 

7 

6 

21 

13 

0.900 

0.890 

0.860 

0.860 

22 

8 

9 

20 

17 

0.870 

0.870 

0.600 

0.600 

21 

10 

3 

27 

4 

0.920 

0.960 

0.870 

0.870 

10 

4 

2 

30 

15 

0.920 

0.980 

0.930 

0.930 

8 

0 

5 

14 

9 

0.910 

0.920 

1.000 

1.000 

19 

7 

7 

28 

14 

0.910 

0.910 

0.900 

0.900 

32 

14 

6 

38 

10 

0.890 

0.930 

0.830 

0.830 
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Appendix  BD:  Nellis  AFB  Data 


Nellis  |57FW|  Poil-1 


F 

qht  Homs 

MXG 

2A2W 

Manning 

OA 

Manning 

Effect 

(tate) 

Break  (rate 

:ix  (late) 

A-10A 

F-15E 

F-15C 

F-16  (30) 

F-16  (40) 

F-16  (50) 

A-10A 

F-15E 

F-15C 

F-16  (30) 

F-16  (40) 

F-16  (50) 

A-10A 

F-15E 

F-15C 

F-16  (30) 

F-16  (40) 

F-16  (50) 

Jtin  03 

365.5 

199.9 

283.5 

106.6 

367.8 

0 

0.867 

0.093 

0.248 

0.181 

0 

102 

0.062 

0.000 

0.895 

0.486 

0.413 

0.556 

0.522 

1.000 

Fell  03 

305.2 

193 

231.8 

388.9 

192.7 

0 

0.867 

0.100 

0.105 

0.150 

0 

062 

0.087 

0.000 

1.000 

0.786 

0.647 

0.824 

0.800 

1.000 

Mill  03 

311.4 

214.2 

312.4 

373.6 

382.8 

0 

0.867 

0.130 

0.135 

0.177 

0 

045 

0.077 

0.000 

0.833 

0.522 

0.659 

0.692 

0.737 

1.000 

Apt  03 

163.9 

270.6 

306.3 

116.3 

316.9 

0 

0.867 

0.094 

0.101 

0.125 

0 

103 

0.127 

0.000 

0.696 

0.611 

0.839 

0.774 

0.688 

1.000 

May  03 

372 

208.1 

276.4 

195 

305.9 

197 

0.867 

0.057 

0.097 

0.149 

0 

038 

0.113 

0.140 

0.545 

0.500 

0.677 

0.833 

0.800 

0.400 

Jim  03 

355.9 

211.9 

357.8 

171.6 

249.5 

214 

0.867 

0.132 

0.204 

0.145 

0 

022 

0.117 

9.040 

0.593 

0.714 

0.611 

1.000 

0.750 

0.733 

Jill  03 

360.9 

223.3 

261.1 

134.6 

278.6 

224 

0.867 

0.088 

0.201 

0.174 

0 

082 

0.078 

0.070 

0.778 

0.700 

0.571 

0.625 

0.636 

0.533 

Aii(|  03 

396.6 

206.1 

254.1 

176.1 

357.8 

349.7 

0.867 

0.187 

0.254 

0.150 

0 

081 

0.110 

0.085 

0.590 

0.471 

0.579 

0.375 

0.621 

0.526 

Sep  03 

356.9 

216.5 

280.2 

110 

396.3 

290.1 

0.867 

0.110 

0.103 

0.159 

0 

111 

0.102 

0.053 

0.571 

0.625 

0.618 

0.778 

0.577 

0.818 

Oct  03 

375 

200.6 

311 

189.1 

310.8 

310.1 

0.867 

0.164 

0.175 

0.158 

0 

089 

0.104 

0.104 

0.903 

0.720 

0.667 

0.636 

0.577 

0.625 

Nov  03 

221.5 

161.1 

208.7 

116.6 

249.3 

204.3 

0.867 

0.144 

0.133 

0.199 

0 

093 

0.077 

0.104 

0.824 

0.933 

0.875 

0.889 

0.571 

0.500 

Dec  03 

213.8 

198.8 

213.3 

139.3 

228.1 

202.7 

0.867 

0.064 

0.148 

0.236 

0 

051 

0.043 

0.084 

0.857 

0.667 

0.595 

0.220 

0.667 

0.727 

Jan  01 

352.3 

226.3 

217.8 

198 

278.4 

216.5 

0 

827 

0.867 

0.217 

0.313 

0.304 

0 

075 

0.087 

0.066 

0.775 

0.750 

0.836 

0.800 

0.566 

0.615 

Fell  01 

297.3 

188.8 

221.3 

153 

324,1 

232.6 

0 

825 

0.867 

0.222 

0.265 

0.236 

0 

031 

0.087 

0.135 

0.857 

0.914 

0.887 

0.667 

0.700 

0.500 

Mai  01 

412.8 

287.6 

395.5 

317.8 

341.2 

360.3 

0 

825 

0.867 

0.231 

0.210 

0.156 

0 

056 

0.088 

0.142 

0.878 

0.821 

0.667 

0.556 

0.526 

0.600 

ApiOl 

359.6 

231.8 

301.7 

178.9 

317.6 

303.7 

0 

831 

0.867 

0.176 

0.352 

0.194 

0 

029 

0.059 

0.100 

0.777 

0.679 

0.600 

0.000 

0.571 

0.500 

May  01 

319.2 

200.2 

239.2 

169.8 

386.8 

280.3 

0 

873 

0.867 

0.117 

0.292 

0.225 

0 

104 

0.068 

0.070 

0.905 

0.686 

0.667 

0.500 

0.474 

0.500 

Jim  01 

297 

187.9 

261.5 

183.7 

309 

222.5 

0 

877 

0.867 

0.168 

0.333 

0.289 

0 

080 

0.038 

0.087 

0.960 

0.750 

0.705 

0.625 

0.667 

0.600 

Jnl  01 

312.9 

189.4 

249.2 

150 

310.2 

148.5 

0 

895 

0.933 

0.213 

0.230 

0.297 

0 

107 

0.064 

0.090 

0.771 

0.735 

0.771 

0.583 

0.476 

0.571 

Ant)  01 

108.6 

208 

267.9 

223.2 

128 

244.5 

0 

927 

0.933 

0.237 

0.260 

0.238 

0 

058 

0.056 

0.074 

0.900 

0.550 

0.754 

0.625 

0.882 

0.643 

Sep  01 

266.6 

181.1 

212.8 

105.8 

332.7 

175.6 

0 

930 

0.933 

0.236 

0.366 

0.280 

0 

024 

0.109 

0.060 

0.727 

0.750 

0.704 

1.000 

0.840 

0.625 

Oct  01 

308.8 

159.9 

273.5 

192.5 

318.7 

200.4 

0 

926 

0.933 

0.201 

0.366 

0.223 

0 

081 

0.093 

0.083 

0.818 

0.733 

0.750 

0.556 

0.571 

0.818 

Nov  01 

311.2 

157.4 

296.1 

176.1 

363.4 

230.9 

0 

927 

0.933 

0.136 

0.336 

0.206 

0 

064 

0.073 

0.075 

0.810 

0.789 

0.795 

0.571 

0.333 

0.667 

Dec  01 

166 

146.2 

191.2 

131 

221.2 

218.6 

0 

934 

0.933 

0.122 

0.381 

0.191 

0 

095 

0.084 

0.084 

0.667 

0.865 

0.846 

0.600 

0.538 

0.500 
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Nellis  (57FW)  Part-2 


F 

yinq  Sched  Effect  (rate) 

MX  Sched  Effect  (rate 

A 

bort  (rate 

A-10A 

F-15E 

F-15C 

F-16  (30) 

F-16  (40) 

F-16 (50) 

A-10A 

F-15E 

F-15C 

F-16  Falcon 

F-16  Viper 

A-10A 

F-15E 

F-15C 

F-16  (30) 

F-16  (40) 

F-16  (50) 

0.981 

0.808 

0.815 

0.765 

0.955 

0.000 

1.000 

0.996 

0.971 

0.988 

0.971 

0.005 

0.058 

0.063 

0.026 

0.034 

0.000 

0.827 

0.876 

0.890 

0.849 

0.890 

0.000 

1.000 

1.000 

1.000 

0.995 

0.991 

0.024 

0.089 

0.059 

0.042 

0.047 

0.000 

0.894 

0.791 

0.795 

0.859 

0.887 

0.000 

1.000 

0.969 

1.000 

0.948 

0.993 

0.016 

0.061 

0.065 

0.037 

0.039 

0.000 

0.929 

0.947 

0.844 

0.867 

0.938 

0.000 

0.995 

0.976 

0.992 

4.000 

0.976 

0.036 

0.038 

0.061 

0.057 

0.070 

0.000 

0.803 

0.863 

0.727 

0.975 

0.893 

0.899 

1.000 

1.000 

1.000 

1.000 

1.000 

0.040 

0.021 

0.051 

0.006 

0.083 

0.053 

0.890 

0.837 

0.846 

0.926 

0.862 

0.846 

1.000 

1.000 

1.000 

0.970 

0.992 

0.047 

0.074 

0.046 

0.014 

0.072 

0.053 

0.811 

0.825 

0.752 

0.586 

0.866 

0.803 

1.000 

0.977 

0.989 

0.997 

0.912 

0.038 

0.057 

0.069 

0.067 

0.047 

0.044 

0.761 

0.590 

0.762 

0.873 

0.805 

0.861 

0.968 

0.989 

0.956 

0.987 

0.989 

0.028 

0.114 

0.073 

0.093 

0.061 

0.055 

0.881 

0.791 

0.766 

0.613 

0.875 

0.788 

0.976 

0.968 

0.931 

0.992 

0.987 

0.015 

0.088 

0.093 

0.060 

0.045 

0.037 

0.849 

0.811 

0.770 

0.878 

0.853 

0.815 

0.967 

0.991 

0.974 

1.000 

1.000 

0.051 

0.113 

0.099 

0.016 

0.057 

0.065 

0.692 

0.833 

0.665 

0.798 

0.861 

0.862 

0.976 

0.970 

0.973 

0.926 

0.968 

0.025 

0.082 

0.101 

0.058 

0.113 

0.084 

0.709 

0.909 

0.742 

0.861 

0.852 

0.764 

0.987 

0.993 

0.925 

0.964 

0.977 

0.027 

0.135 

0.104 

0.092 

0.110 

0.133 

0.934 

0.869 

0.695 

0.850 

0.909 

0.873 

0.946 

0.925 

0.960 

0.942 

0.987 

0.032 

0.078 

0.082 

0.096 

0.076 

0.125 

0.819 

0.852 

0.839 

0.716 

0.741 

0.677 

1.000 

0.993 

0.936 

0.949 

0.956 

0.031 

0.114 

0.063 

0.110 

0.091 

0.110 

0.906 

0.920 

0.756 

0.910 

0.892 

0.837 

0.948 

1.000 

0.987 

0.985 

0.980 

0.083 

0.070 

0.046 

0.102 

0.077 

0.043 

0.867 

0.824 

0.747 

0.726 

0.820 

0.864 

0.985 

1.000 

0.966 

1.000 

0.950 

0.065 

0.065 

0.073 

0.061 

0.074 

0.044 

0.907 

0.794 

0.644 

0.593 

0.890 

0.825 

1.000 

1.000 

1.000 

1.000 

1.000 

0.022 

0.077 

0.121 

0.025 

0.089 

0.056 

0.808 

0.744 

0.789 

0.858 

0.852 

0.825 

1.000 

1.000 

1.000 

0.996 

1.000 

0.045 

0.122 

0.107 

0.048 

0.129 

0.076 

0.713 

0.772 

0.833 

0.787 

0.935 

0.896 

1.000 

1.000 

1.000 

1.000 

1.000 

0.057 

0.124 

0.116 

0.059 

0.070 

0.049 

0.890 

0.824 

0.865 

0.894 

0.883 

0.895 

1.000 

0.983 

1.000 

1.000 

0.993 

0.045 

0.107 

0.062 

0.014 

0.137 

0.121 

0.791 

0.800 

0.819 

0.964 

0.891 

0.836 

0.974 

1.000 

0.947 

0.996 

0.953 

0.079 

0.071 

0.072 

0.034 

0.084 

0.043 

0.759 

0.706 

0.752 

0.777 

0.700 

0.712 

0.973 

0.984 

0.975 

1.000 

1.000 

0.024 

0.159 

0.112 

0.112 

0.085 

0.113 

0.866 

0.791 

0.890 

0.901 

0.893 

0.870 

0.906 

0.989 

0.989 

0.975 

0.972 

0.025 

0.117 

0.070 

0.076 

0.160 

0.122 

0.737 

0.792 

0.764 

0.780 

0.781 

0.713 

0.984 

0.986 

0.995 

1.000 

0.980 

0.098 

0.076 

0.088 

0.076 

0.094 

0.173 
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Nellis  (57FW)  Part-3 


FE  (rate) 

MX/O 

ps  Devs  (count) 

MC  (rate) 

A-10A 

F-15E 

F-15C 

F-16  (30) 

F-16  (40) 

F-16  (50) 

A-10A 

F-15E 

F-15C 

F-16  (30) 

F-16  (40) 

F-16  (50) 

A-10A 

F-15E 

F-15C 

F-16  (30) 

F-16  (40) 

F-16  (50) 

0.010 

0.020 

0.036 

0.010 

0.003 

0.000 

0 

13 

28 

22 

2 

0 

0.802 

0.632 

0.585 

0.693 

0.772 

0.000 

0.019 

0.008 

0.013 

0.000 

0.000 

0.000 

5 

15 

14 

17 

15 

0 

0.834 

0.634 

0.678 

0.740 

0.784 

0.000 

0.022 

0.024 

0.016 

0.000 

0.004 

0.000 

9 

8 

17 

11 

3 

0 

0.844 

0.673 

0.631 

0.801 

0.818 

0.000 

0.016 

0.000 

0.009 

0.000 

0.000 

0.000 

3 

1 

18 

13 

3 

0 

0.813 

0.726 

0.736 

0.785 

0.819 

0.000 

0.010 

0.000 

0.000 

0.000 

0.000 

0.007 

23 

2 

19 

1 

6 

5 

0.765 

0.793 

0.729 

0.838 

0.751 

0.724 

0.019 

0.007 

0.004 

0.000 

0.005 

0.013 

14 

14 

17 

0 

5 

4 

0.779 

0.634 

0.742 

0.817 

0.774 

0.873 

0.000 

0.020 

0.000 

0.000 

0.007 

0.000 

16 

11 

22 

14 

12 

13 

0.707 

0.668 

0.607 

0.731 

0.868 

0.774 

0.019 

0.045 

0.010 

0.000 

0.004 

0.005 

34 

39 

30 

2 

13 

7 

0.703 

0.468 

0.647 

0.666 

0.788 

0.802 

0.021 

0.006 

0.000 

0.025 

0.010 

0.005 

12 

18 

24 

4 

8 

12 

0.753 

0.595 

0.728 

0.643 

0.743 

0.821 

0.016 

0.021 

0.000 

0.010 

0.000 

0.012 

10 

14 

31 

3 

7 

9 

0.764 

0.656 

0.759 

0.779 

0.729 

0.742 

0.010 

0.010 

0.000 

0.000 

0.011 

0.006 

9 

10 

13 

6 

19 

11 

0.654 

0.741 

0.866 

0.767 

0.709 

0.727 

0.000 

0.008 

0.032 

0.000 

0.014 

0.000 

21 

9 

19 

5 

16 

23 

0.592 

0.757 

0.672 

0.781 

0.788 

0.801 

0.022 

0.012 

0.017 

0.015 

0.000 

0.000 

7 

12 

38 

7 

12 

23 

0.716 

0.677 

0.633 

0.856 

0.743 

0.782 

0.013 

0.015 

0.004 

0.000 

0.004 

0.000 

12 

8 

8 

7 

9 

19 

0.565 

0.619 

0.752 

0.743 

0.797 

0.737 

0.009 

0.000 

0.012 

0.019 

0.014 

0.004 

13 

10 

18 

4 

6 

14 

0.694 

0.712 

0.639 

0.770 

0.715 

0.810 

0.032 

0.005 

0.019 

0.000 

0.000 

0.008 

13 

17 

14 

10 

10 

9 

0.675 

0.553 

0.678 

0.609 

0.763 

0.814 

0.011 

0.000 

0.006 

0.026 

0.004 

0.000 

8 

10 

24 

7 

6 

3 

0.680 

0.579 

0.635 

0.720 

0.791 

0.836 

0.007 

0.016 

0.014 

0.000 

0.008 

0.006 

6 

23 

12 

5 

9 

9 

0.661 

0.537 

0.721 

0.755 

0.724 

0.866 

0.024 

0.000 

0.008 

0.027 

0.000 

0.006 

33 

23 

10 

4 

10 

2 

0.543 

0.605 

0.622 

0.851 

0.755 

0.847 

0.014 

0.032 

0.000 

0.000 

0.000 

0.005 

11 

19 

9 

0 

10 

6 

0.728 

0.582 

0.683 

0.821 

0.818 

0.841 

0.050 

0.015 

0.016 

0.000 

0.004 

0.000 

19 

7 

5 

3 

1 

3 

0.602 

0.756 

0.770 

0.897 

0.834 

0.820 

0.030 

0.016 

0.005 

0.000 

0.009 

0.015 

18 

15 

15 

0 

10 

2 

0.640 

0.700 

0.765 

0.898 

0.808 

0.802 

0.000 

0.000 

0.005 

0.000 

0.000 

0.006 

7 

6 

4 

3 

5 

6 

0.650 

0.758 

0.833 

0.707 

0.792 

0.883 

0.027 

0.010 

0.007 

0.000 

0.000 

0.007 

11 

13 

21 

3 

16 

29 

0.662 

0.716 

0.844 

0.857 

0.850 

0.822 
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Nellis  (57FW)  Part4 


Repeat  (rate) 

Recur  (rate) 

TN 

MCM  (rate) 

A-10A 

F-15E 

F-15C 

F-16  Falcon 

F-16  Viper 

A-10A 

F-15E 

F-15C 

F-16  Falcon 

F-16  Viper 

A-10A 

F-15E 

F-15C 

F-16  (30) 

F-16  (40) 

F-16  (50) 

0.009 

0.044 

0.033 

0.009 

0.015 

0.019 

0.025 

0.014 

0.019 

0.022 

0.169 

0.164 

0.271 

0.167 

0.087 

0.000 

0.009 

0.024 

0.005 

0.010 

0.017 

0.006 

0.000 

0.023 

0.003 

0.000 

0.113 

0.225 

0.244 

0.151 

0.119 

0.000 

0.004 

0.005 

0.005 

0.004 

0.018 

0.019 

0.005 

0.015 

0.025 

0.006 

0.135 

0.250 

0.265 

0.142 

0.138 

0.000 

0.017 

0.024 

0.000 

0.025 

0.011 

0.006 

0.030 

0.000 

0.014 

0.011 

0.177 

0.132 

0.180 

0.133 

0.125 

0.000 

0.028 

0.006 

0.012 

0.030 

0.059 

0.031 

0.006 

0.000 

0.030 

0.019 

0.186 

0.090 

0.186 

0.068 

0.148 

0.156 

0.024 

0.010 

0.024 

0.022 

0.011 

0.044 

0.045 

0.018 

0.049 

0.044 

0.195 

0.184 

0.196 

0.100 

0.140 

0.097 

0.019 

0.014 

0.014 

0.022 

0.018 

0.008 

0.014 

0.014 

0.011 

0.062 

0.252 

0.229 

0.274 

0.227 

0.068 

0.148 

0.027 

0.007 

0.004 

0.027 

0.017 

0.015 

0.022 

0.009 

0.015 

0.041 

0.285 

0.423 

0.252 

0.263 

0.123 

0.116 

0.000 

0.015 

0.037 

0.000 

0.028 

0.007 

0.015 

0.005 

0.007 

0.028 

0.219 

0.275 

0.222 

0.222 

0.145 

0.103 

0.013 

0.008 

0.013 

0.012 

0.011 

0.025 

0.027 

0.000 

0.048 

0.034 

0.209 

0.298 

0.172 

0.185 

0.184 

0.168 

0.010 

0.000 

0.015 

0.005 

0.000 

0.010 

0.000 

0.000 

0.005 

0.047 

0.274 

0.163 

0.118 

0.127 

0.212 

0.198 

0.010 

0.000 

0.000 

0.008 

0.009 

0.000 

0.000 

0.008 

0.000 

0.019 

0.382 

0.173 

0.194 

0.114 

0.119 

0.170 

0.016 

0.004 

0.007 

0.007 

0.012 

0.054 

0.025 

0.000 

0.021 

0.024 

0.222 

0.226 

0.266 

0.104 

0.179 

0.136 

0.014 

0.012 

0.005 

0.000 

0.016 

0.014 

0.006 

0.005 

0.000 

0.023 

0.299 

0.238 

0.182 

0.206 

0.136 

0.234 

0.007 

0.009 

0.000 

0.027 

0.045 

0.000 

0.000 

0.000 

0.015 

0.007 

0.205 

0.141 

0.228 

0.132 

0.231 

0.152 

0.006 

0.024 

0.013 

0.024 

0.011 

0.018 

0.019 

0.006 

0.036 

0.021 

0.200 

0.298 

0.256 

0.269 

0.204 

0.165 

0.000 

0.000 

0.014 

0.006 

0.011 

0.022 

0.014 

0.007 

0.018 

0.034 

0.189 

0.255 

0.262 

0.208 

0.104 

0.136 

0.000 

0.005 

0.010 

0.000 

0.007 

0.000 

0.010 

0.005 

0.024 

0.047 

0.225 

0.272 

0.228 

0.231 

0.188 

0.121 

0.007 

0.000 

0.027 

0.012 

0.024 

0.028 

0.017 

0.005 

0.000 

0.016 

0.323 

0.283 

0.322 

0.096 

0.175 

0.128 

0.000 

0.000 

0.000 

0.011 

0.023 

0.010 

0.011 

0.004 

0.021 

0.038 

0,194 

0.243 

0.251 

0.121 

0.115 

0.115 

0.000 

0.018 

0.011 

0.017 

0.000 

0.006 

0.018 

0.000 

0.011 

0.050 

0.281 

0.153 

0.180 

0.048 

0.128 

0.163 

0.006 

0.019 

0.021 

0.000 

0.010 

0.000 

0.019 

0.000 

0.000 

0.042 

0.229 

0.201 

0.124 

0.100 

0.118 

0.155 

0.016 

0.006 

0.019 

0.006 

0.011 

0.000 

0.017 

0.000 

0.019 

0.075 

0.380 

0.121 

0.096 

0.186 

0.136 

0.087 

0.028 

0.007 

0.019 

0.037 

0.054 

0.028 

0.013 

0.000 

0.009 

0.076 

0.272 

0.206 

0.106 

0.071 

0.093 

0.100 
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Ne 

lis  (57FW)  Part-5 

CANN  (rate) 

DOPs 

(count) 

FODs 

(count) 

Combined 

Mishaps 

(count) 

Flight 

Mishaps 

(count) 

Ground 

Mishaps 

(count) 

STVs 

(count) 

DSVs 

(count) 

TDVs 

(count) 

DRs  Sub 
(count) 

TO  Imp 
Sub 
(count) 

QVI 

Pass 

(rate) 

KTL 

Pass 

(rate) 

Phase 

KTL 

(rate) 

PE 

Pass 

(rate) 

A-10A 

F-15E 

F-15C 

F-16  (30) 

F-16  (40) 

F-16  (50) 

0.146 

0.235 

0.272 

0.075 

0.038 

0.000 

2 

15 

2 

2 

0 

14 

1 

0 

62 

21 

0.900 

0.833 

0.931 

0.98 

0.094 

0.173 

0.310 

0.051 

0.064 

0.000 

1 

19 

1 

0 

1 

9 

0 

0 

33 

29 

0.924 

0.860 

0.913 

0.96 

0.054 

0.176 

0.129 

0.024 

0.125 

0.000 

3 

14 

0 

0 

0 

6 

0 

1 

30 

10 

0.912 

0.838 

0.926 

0.97 

0.061 

0.123 

0.149 

0.050 

0.083 

0.000 

3 

11 

2 

0 

2 

5 

1 

0 

19 

18 

0.914 

0.818 

0.911 

0.96 

0.0/8 

0.167 

0.139 

0.019 

0.162 

0.028 

4 

20 

1 

1 

0 

10 

0 

0 

25 

4? 

0.904 

0.783 

0.930 

0.95 

0.049 

0.241 

0.153 

0.029 

0.180 

0.063 

4 

14 

1 

0 

1 

4 

1 

1 

39 

26 

0.918 

0.855 

0.913 

0.96 

0.044 

0.154 

0.178 

0.061 

0.102 

0.153 

3 

20 

0 

0 

0 

9 

3 

0 

25 

16 

0.910 

0.885 

0.915 

0.96 

0.024 

0.299 

0.265 

0.061 

0.133 

0.11? 

3 

38 

0 

0 

0 

15 

0 

2 

69 

37 

0.916 

0.748 

0.910 

0.98 

0.04? 

0.303 

0.159 

0.099 

0.133 

0.082 

2 

34 

1 

1 

0 

8 

0 

3 

59 

26 

0.906 

0.785 

0.889 

0.94 

0.085 

0.203 

0.283 

0.048 

0.140 

0.082 

4 

18 

0 

0 

0 

10 

1 

1 

44 

25 

0.906 

0.833 

0.949 

0.94 

0.025 

0.195 

0.124 

0.113 

0.115 

0.058 

2 

17 

0 

0 

0 

12 

2 

0 

28 

9 

0.924 

0.798 

0.940 

0.97 

0.174 

0.344 

0.185 

0.020 

0.115 

0.038 

0 

17 

0 

0 

0 

12 

1 

3 

46 

12 

0.904 

0.843 

0.918 

0.99 

0.098 

0.21? 

0.177 

0.045 

0.101 

0.066 

0 

25 

3 

1 

2 

9 

4 

1 

34 

11 

0.923 

0.882 

0.941 

0.98 

0.215 

0.265 

0.142 

0.072 

0.056 

0.006 

3 

18 

0 

0 

0 

12 

5 

0 

30 

3 

0.906 

0.852 

0.911 

0.96 

0.170 

0.269 

0,116 

0.043 

0.157 

0.053 

3 

19 

1 

1 

0 

13 

6 

1 

51 

9 

0.914 

0.866 

0.918 

0.97 

0.134 

0.252 

0.262 

0.050 

0.113 

0.008 

3 

19 

3 

2 

1 

6 

2 

1 

45 

16 

0.927 

0.856 

0.936 

0.96 

0.06? 

0.375 

0,156 

0.195 

0.090 

0.016 

2 

12 

1 

1 

0 

20 

3 

2 

24 

10 

0.888 

0.799 

0.781 

0.95 

0.195 

0.326 

0.280 

0.010 

0.143 

0.012 

1 

17 

2 

1 

1 

7 

2 

0 

78 

20 

0.927 

0.899 

0.975 

0.96 

0.341 

0.426 

0.203 

0.098 

0.091 

0.026 

0 

13 

2 

1 

1 

13 

3 

1 

65 

26 

0.909 

0.860 

1.000 

0.96 

0.123 

0.442 

0.319 

0.044 

0.089 

0.016 

5 

16 

1 

0 

1 

15 

0 

1 

66 

25 

0.904 

0.852 

0.829 

0.98 

0.171 

0.305 

0.20? 

0.048 

0.078 

0.000 

4 

15 

3 

2 

1 

8 

0 

1 

60 

9 

0.896 

0.873 

0.867 

0.94 

0.195 

0.431 

0.274 

0.000 

0.115 

0.060 

3 

8 

1 

0 

1 

5 

2 

0 

51 

31 

0.907 

0.884 

0.878 

0.94 

0.149 

0.549 

0.164 

0.092 

0.060 

0.038 

1 

13 

0 

0 

0 

12 

2 

3 

55 

16 

0.919 

0.834 

1.000 

0.9? 

0.260 

0.410 

0.095 

0.007 

0.050 

0.021 

1 

12 

0 

0 

0 

10 

0 

1 

52 

18 

0.924 

0.912 

0.941 

0.93 
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Appendix  BE:  Offutt  AFB  Data 


Offutt 

I55RWI 

Pan-1 

Flii|litHom$ 

IXG 

2A2W 

Maiming 

OA 

Manning 

Effect 

(late) 

Break  (rate) 

Fix 

rate) 

Flying  Sclieil 
Effect  (late) 

MX  Sclieil 
Effect  (tale) 

Alioit  (rate) 

IFE 

rate) 

MX  Ops 
Devs  (count) 

MC  (rate) 

Repeat  (rate) 

Recm  (tate) 

E4B 

RC-135| 

E4B 

RC-135 

E4B 

RC-135 

E4B 

RC-135 

E4B 

RC-135 

E4B 

RC-135 

E4B 

RC-135 

E4E! 

RC-135 

E4B 

RC-135 

E4B 

RC-135 

E4B 

RC-135 

Jan  03 

113.7 

825.4 

0.652 

0.100 

0.184 

0.250 

0.476 

0.600 

0.750 

0.889 

0.909 

0.048 

0.068 

0.000 

0.005 

12 

12 

0.554 

0.768 

0.000 

0.019 

0.000 

0.015 

Fell  03 

122.4 

950.1 

0.652 

0.033 

0.185 

0,000 

0.455 

0.433 

0.747 

0.941 

0.882 

0.032 

0.080 

0.000 

0.018 

18 

18 

0.710 

0.753 

0.044 

0.013 

0.029 

0.011 

lil, ii  03 

134.2 

1474.4 

0.652 

0.031 

0.176 

0.000 

0.536 

0.590 

0.902 

0.818 

0.750 

0.030 

0.049 

0.000 

0.000 

7 

10 

0.716 

0.700 

0.010 

0.007 

0.000 

0.001 

Apt  03 

146 

1466.1 

0.652 

0.021 

0.211 

1.000 

0.567 

0.769 

0.868 

0.818 

0.900 

0.000 

0.099 

0.000 

0.000 

6 

13 

0.824 

0.714 

0.000 

0.005 

0.013 

0.012 

liiy  03 

146.5 

750.7 

0.652 

0.026 

0.175 

1.000 

0.444 

0.821 

0.703 

1.000 

0.844 

0.000 

0.073 

0.000 

0.005 

4 

27 

0.932 

0.674 

0.000 

0.030 

0.011 

0.010 

Jim  03 

138.1 

863,8 

0.652 

0.057 

0.169 

1.000 

0.619 

0.722 

0.769 

0.500 

0.931 

0.000 

0.047 

0.000 

0.009 

6 

15 

0.886 

0.745 

0.000 

0.025 

0.026 

0.018 

Jul  03 

130.3 

931.4 

0.652 

0.032 

0.236 

0.000 

0.500 

0.771 

0.703 

0.667 

0.677 

0.000 

0.060 

0.000 

0.000 

3 

22 

0,904 

0.766 

0.018 

0.018 

0.000 

0.017 

Aik)  03 

88.7 

839 

0.652 

0.030 

0.198 

0.000 

0.478 

0.692 

0.736 

0.905 

0.917 

0.000 

0.051 

0.000 

0.015 

3 

15 

0.846 

0.760 

0.000 

0.011 

0.000 

0.024 

Sep  03 

131.4 

647.2 

0.652 

0.054 

0.228 

0.500 

0.524 

0.711 

0.561 

1.000 

0.793 

0.079 

0.101 

0.000 

0.000 

2 

16 

0.861 

0.613 

0.000 

0.012 

0.025 

0.012 

Oct  03 

128.1 

859.8 

0.689 

0.111 

0.214 

0.500 

0.560 

0.676 

0.808 

0.920 

0.774 

0.000 

0.025 

0.000 

0.009 

6 

11 

0.726 

0.775 

0.000 

0.013 

0.000 

0.005 

Nov  03 

96.8 

739.3 

0.689 

0.000 

0.267 

1.000 

0.593 

0.710 

0.709 

1.000 

0.983 

0.000 

0.049 

0.000 

0.005 

7 

11 

0.919 

0.781 

0.000 

0.006 

0.026 

0.004 

Dec  03 

130.7 

815.9 

0.689 

0.028 

0.198 

1.000 

0.435 

0.787 

0.742 

0.932 

0.827 

0.045 

0.076 

0.024 

0.000 

4 

17 

0.877 

0.761 

0.000 

0.006 

0.011 

0.006 

Jon  04 

124.2 

762.4 

0.841 

0.726 

0.028 

0.133 

1,000 

0.500 

0.675 

0.537 

1,000 

0.744 

0.000 

0.064 

0.000 

0.000 

6 

30 

0.789 

0.801 

0.014 

0.011 

0.029 

0.004 

Feb  04 

112 

771.5 

0.821 

0.726 

0.030 

0.144 

0.000 

0.571 

0.533 

0.644 

0.912 

0.909 

0.000 

0.050 

0.000 

0.000 

11 

22 

0.567 

0.806 

0.000 

0.015 

0.021 

0.002 

Mai  0J 

148.3 

958,6 

0.818 

0.726 

0.023 

0.214 

0.000 

0.643 

0.635 

0.713 

1.000 

0.988 

0.043 

0.096 

0.000 

0.000 

8 

25 

0.688 

0.814 

0.015 

0.007 

0.000 

0.009 

A|>i  04 

179.3 

1075.7 

0.914 

0.763 

0.047 

0.293 

0.500 

0.756 

0.761 

0.900 

0.889 

1.000 

0.023 

0.028 

0.000 

0.000 

5 

10 

0.819 

0.762 

0.000 

0.016 

0.000 

0.006 

May  04 

162.7 

1105.1 

0.905 

0.763 

0.020 

0.283 

0.000 

0.561 

0.733 

0.789 

1.000 

1.000 

0.000 

0.085 

0.000 

0.003 

4 

21 

0.714 

0.699 

0.000 

0.004 

0.000 

0.009 

Jim  04 

188.4 

1236.2 

0.902 

0.763 

0.000 

0.263 

1.000 

0.732 

0.919 

0.882 

0.930 

0.889 

0.000 

0.044 

0.000 

0.003 

0 

12 

0.919 

0.736 

0.000 

0.011 

0.000 

0.007 

Jul  04 

99.8 

1175.1 

0.886 

0.763 

0.000 

0.200 

1.000 

0.679 

0.842 

0.766 

1.000 

0.966 

0.000 

0.101 

0.000 

0.000 

3 

22 

0.729 

0.691 

0.000 

0.017 

0.031 

0.008 

Aik)  04 

144.3 

1183.5 

0.966 

0.807 

0.000 

0.158 

1.000 

0.520 

0.686 

0,853 

1.000 

1.000 

0.000 

0.031 

0.000 

0.006 

6 

11 

0.732 

0.730 

0.012 

0.004 

0.012 

0.006 

Sep  04 

86.6 

1191 

0.956 

0.807 

0.061 

0.144 

0.500 

0.609 

0.722 

0.754 

1.000 

0.969 

0.059 

0.043 

0.000 

0.000 

5 

26 

0.741 

0.740 

0.000 

0.012 

0.013 

0.009 

Oct  04 

179.2 

1147.5 

0.911 

0.807 

0.000 

0.174 

1.000 

0.593 

0.894 

0.810 

0.963 

0.640 

0.000 

0.044 

0.000 

0.003 

3 

12 

0.656 

0.757 

0.000 

0.018 

0.000 

0.019 

Nov  04 

137.7 

1102.1 

0.897 

0.807 

0.083 

0.193 

0.667 

0.593 

0.786 

0.752 

1.000 

0.792 

0.000 

0.075 

0.029 

0.000 

5 

25 

0.853 

0.783 

0.000 

0.004 

0.000 

0.007 

Dec  04 

98.1 

1130.6 

0.894 

0.807 

0.120 

0.183 

0.667 

0.615 

0.677 

0.834 

0.621 

1.000 

0.077 

0.062 

0.000 

0.010 

5 

21 

0.646 

0.828 

0.037 

0.014 

0.000 

0.012 
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Offutt  (55RW)  Part-2 


TNMCM 

(rate) 

CANN  (rate) 

DOPs 

(count) 

FODs 

(count) 

Combined 

Mishaps 

(count) 

Flight 

Mishaps 

(count) 

Ground 

Mishaps 

(count) 

STVs 

(count) 

DSVs 

(count) 

TDVs 

(count) 

DRs 

Sub 

(count) 

TO  Imp 
Sub 
(count) 

QVI 

Pass 

(rate) 

KTL 

Pass 

(rate) 

Phase 

KTL 

(rate) 

PE 

Pass 

(rate) 

E-4B 

RC-135 

E4B 

RC-135 

0.414 

0.209 

0.150 

0.026 

1 

4 

0 

0 

0 

8 

6 

2 

8 

10 

0.925 

0.804 

1.000 

1.000 

0.260 

0.173 

0.367 

0.025 

1 

6 

0 

0 

0 

6 

3 

3 

14 

12 

0.953 

0.962 

1.000 

1.000 

0.234 

0.166 

0.281 

0.075 

1 

0 

0 

0 

0 

7 

7 

0 

4 

30 

0.920 

0.864 

1.000 

1.000 

0.139 

0.135 

0.000 

0.134 

1 

0 

0 

0 

0 

3 

3 

0 

5 

35 

0.942 

0.833 

1.000 

1.000 

0.024 

0.256 

0.128 

0.097 

0 

0 

0 

0 

0 

2 

2 

0 

16 

21 

0.940 

0.947 

1.000 

0.889 

0.105 

0.206 

0.029 

0.113 

1 

0 

0 

0 

0 

3 

1 

2 

12 

15 

0.963 

0.818 

1.000 

1.000 

0.077 

0.184 

0.000 

0.087 

2 

2 

1 

0 

1 

9 

8 

1 

10 

18 

0.901 

0.885 

1.000 

1.000 

0.142 

0.150 

0.091 

0.026 

1 

2 

0 

0 

0 

2 

2 

0 

2 

24 

0.951 

1.000 

1.000 

0.842 

0.125 

0.234 

0.027 

0.054 

1 

4 

0 

0 

0 

4 

3 

1 

3 

24 

0.942 

0.750 

0.500 

1.000 

0.158 

0.173 

0.472 

0.077 

1 

2 

1 

1 

0 

0 

0 

0 

10 

8 

0.906 

0.875 

1.000 

1.000 

0.064 

0.174 

0.071 

0.178 

0 

1 

0 

0 

0 

4 

3 

1 

6 

29 

0.939 

0.889 

1.000 

1.000 

0.063 

0.191 

0.143 

0.103 

0 

2 

0 

0 

0 

3 

2 

1 

4 

22 

0.949 

0.958 

1.000 

0.947 

0.158 

0.167 

0.083 

0.124 

0 

5 

0 

0 

0 

6 

4 

2 

14 

6 

0.933 

0.931 

1.000 

1.000 

0.328 

0.160 

0.091 

0.093 

0 

0 

0 

0 

0 

1 

1 

0 

6 

7 

0.949 

0.931 

1.000 

1.000 

0.297 

0.143 

0.136 

0.092 

0 

0 

0 

0 

0 

3 

3 

0 

3 

13 

0.941 

1.000 

1.000 

1.000 

0.078 

0.201 

0.163 

0.036 

0 

1 

0 

0 

0 

5 

5 

0 

10 

26 

0.916 

0.947 

1.000 

1.000 

0.286 

0.206 

0.078 

0.097 

0 

1 

0 

0 

0 

3 

3 

0 

8 

9 

0.927 

0.960 

1.000 

0.920 

0.080 

0.211 

0.023 

0.038 

1 

3 

0 

0 

0 

0 

0 

0 

4 

13 

0.925 

1.000 

1.000 

0.947 

0.219 

0.197 

0.029 

0.021 

1 

3 

0 

0 

0 

2 

2 

0 

15 

13 

0.943 

0.955 

1.000 

1.000 

0.267 

0.219 

0.106 

0.038 

2 

4 

0 

0 

0 

1 

0 

1 

12 

10 

0.951 

0.951 

1.000 

1.000 

0.228 

0.189 

0.091 

0.025 

4 

2 

0 

0 

0 

3 

3 

0 

16 

24 

0.966 

0.970 

1.000 

1.000 

0.071 

0.150 

0.128 

0.084 

1 

1 

0 

0 

0 

3 

3 

0 

15 

24 

0.918 

0.864 

1.000 

1.000 

0.221 

0.180 

0.222 

0.057 

1 

2 

0 

0 

0 

2 

2 

0 

5 

21 

0.949 

0.906 

1.000 

1.000 

0.336 

0.142 

0.000 

0.021 

3 

1 

0 

0 

0 

1 

1 

0 

5 

7 

0.962 

0.950 

1.000 

1.000 
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Appendix  BF:  Pope  AFB  Data 


,ope 

28FG)  Part-1 

Flight 

Homs 

MXG 

2A2W 

Manning 

(late) 

OA 

Manning 

Effect 

(late) 

Bieak 

(late) 

Fix 

(late) 

FSE 

(rate) 

MX 

Sched 

Effect 

(late) 

Alton 

(rate) 

IFE 

(late) 

MX  Ops 
Devs 
(count) 

MC 

Rate 

Repeat 

Rate 

Recur 

Rate 

TNMCM 

Rate 

CANN 

Rate 

DOPs 

(count) 

FODs 

(count) 

Combined 

Mishaps 

(count) 

Jan  03 

1570.8 

0.124 

0.796 

0.834 

0.935 

0.033 

0.000 

40 

0.759 

0.000 

0.004 

0.166 

0.144 

0 

0 

0 

Felt  03 

934 

0.149 

0.818 

0.764 

0.911 

0.046 

0.006 

38 

0.745 

0.002 

0.007 

0.151 

0.245 

0 

0 

0 

Mai  03 

1939.2 

0.274 

0.872 

0.855 

1.000 

0.034 

0.009 

45 

0.743 

0.005 

0.011 

0.177 

0.126 

0 

0 

0 

Api  03 

1978.3 

0.238 

0.820 

0.803 

1.000 

0.034 

0.009 

49 

0.81 

0.007 

0.013 

0.147 

0.114 

0 

0 

0 

May  03 

1493.3 

0.148 

0.709 

0.805 

1.000 

0.031 

0.003 

51 

0.757 

0.054 

0.010 

0.157 

0.114 

0 

2 

0 

Jiiii  03 

1761.5 

0.139 

0.850 

0.847 

0.987 

0.045 

0.005 

46 

0.788 

0.013 

0.010 

0.137 

0.103 

0 

0 

0 

Jill  03 

1114.9 

0.149 

0.681 

0.777 

0.944 

0.065 

0.000 

47 

0.762 

0.015 

0.004 

0.147 

0.186 

0 

0 

0 

Aug  03 

1333.2 

0.180 

0.730 

0.795 

0.840 

0.063 

0.006 

76 

0.764 

0.004 

0.006 

0.188 

0.105 

1 

0 

0 

Sep  03 

1618.4 

0.104 

0.753 

0.794 

0.901 

0.025 

0.003 

24 

0.768 

0.003 

0.000 

0.159 

0.096 

0 

0 

0 

Oct  03 

1599.4 

0.187 

0.800 

0.730 

0.843 

0.061 

0.007 

88 

0.702 

0.012 

0.011 

0.208 

0.118 

0 

1 

0 

Nov  03 

1354.7 

0.182 

0.746 

0.798 

0.945 

0.041 

0.000 

59 

0.686 

0.002 

0.008 

0.243 

0.123 

0 

2 

0 

Dec  03 

854 

0.164 

0.723 

0.640 

0.949 

0.087 

0.012 

77 

0.674 

0.001 

0.017 

0.258 

0.136 

0 

0 

0 

Jan  04 

897 

0.754 

0.755 

0.138 

0.781 

0.684 

0.986 

0.057 

0.001 

58 

0.725 

0.013 

0.001 

0.182 

0.145 

0 

1 

0 

Fell  04 

1023.9 

0.749 

0.755 

0.134 

0.759 

0.658 

0.998 

0.045 

0.002 

51 

0.775 

0.005 

0.011 

0.154 

0.150 

0 

0 

0 

Mai  04 

1737.9 

0.754 

0.755 

0.134 

0.854 

0.855 

0.995 

0.048 

0.001 

77 

0.761 

0.005 

0.004 

0.16 

0.095 

0 

1 

1 

Api  04 

1296.8 

0.882 

0.755 

0.136 

0.752 

0.825 

0.987 

0.063 

0.000 

62 

0.779 

0.000 

0.007 

0.159 

0.155 

0 

0 

1 

May  04 

1248.8 

0.862 

0.811 

0.143 

0.794 

0.851 

0.987 

0.066 

0.007 

56 

0.811 

0.006 

0.003 

0.156 

0.120 

0 

0 

0 

Jim  04 

1401.4 

0.854 

0.866 

0.122 

0.796 

0.794 

0.995 

0.058 

0.000 

63 

0.775 

0.002 

0.000 

0.169 

0.152 

1 

0 

0 

Jill  04 

1177.3 

0.833 

0.866 

0.132 

0.802 

0.797 

0.988 

0.060 

0.000 

52 

0.814 

0.000 

0.003 

0.148 

0.135 

1 

0 

0 

Aui|  04 

1231.8 

0.917 

0.784 

0.147 

0.760 

0.754 

0.973 

0.057 

0.000 

59 

0.77 

0.003 

0.006 

0.185 

0.143 

1 

0 

0 

Sep  04 

753.8 

0.891 

0.840 

0.177 

0.766 

0.673 

0.976 

0.048 

0.002 

33 

0.764 

0.000 

0.013 

0.179 

0.180 

2 

1 

0 

Oct  04 

1101.1 

0.855 

0.896 

0.166 

0.832 

0.738 

0.872 

0.056 

0.012 

57 

0.754 

0.002 

0.003 

0.176 

0.146 

1 

0 

0 

Nov  04 

1208 

0.850 

0.896 

0.122 

0.714 

0.712 

0.818 

0.057 

0.003 

83 

0.73 

0.007 

0.000 

0.196 

0.122 

0 

0 

0 

Dec  04 

1024 

0.845 

0.840 

0.131 

0.747 

0.637 

0.977 

0.076 

0.002 

104 

0.689 

0.003 

0.005 

0.262 

0.192 

0 

0 

1 
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Pope  (28FG(  Part-2 


Flight 

Mishaps 

(count) 

Ground 

Mishaps 

(count) 

STVs 

(count) 

DSVs 

(count) 

TDVs 

(count) 

DRs 

Suh 

(count) 

TO 

Imp 

Suh 

(count) 

OVI 

Pass 

(late) 

KTL 

Pass 

(rate) 

Phase 

KTL 

(late) 

PE 

Pass 

(late) 

0 

0 

2 

0 

0 

5 

0 

0.883 

0.766 

0.778 

0 

0 

1 

1 

0 

8 

1 

0.888 

0.902 

0.810 

0 

0 

1 

0 

1 

3 

1 

0.795 

0.800 

0.400 

0 

0 

2 

0 

0 

13 

1 

0.842 

0.833 

0.643 

0 

0 

3 

0 

0 

4 

2 

0.946 

0.929 

0.778 

0 

0 

3 

0 

0 

5 

3 

0.832 

0.854 

0.739 

0 

0 

0 

0 

0 

6 

0 

0.874 

0.829 

0.600 

0 

0 

6 

1 

0 

8 

0 

0.842 

0.856 

0.750 

0 

0 

3 

0 

0 

2 

2 

0.883 

0.863 

0.850 

0 

0 

6 

0 

0 

3 

0 

0.832 

0.872 

0.786 

0 

0 

11 

3 

3 

8 

2 

0.916 

0.882 

0.889 

0 

0 

3 

0 

2 

4 

2 

0.866 

0.908 

0.857 

0 

0 

15 

1 

8 

4 

3 

0.867 

0.938 

0.800 

0.980 

0 

0 

13 

3 

2 

11 

0 

0.889 

0.882 

0.667 

1.000 

0 

1 

5 

1 

3 

6 

1 

0.919 

0.924 

0.833 

1.000 

1 

0 

9 

0 

3 

1 

7 

0.849 

0.857 

0.667 

0.980 

0 

0 

10 

7 

1 

11 

9 

0.887 

0.974 

1.000 

1.000 

0 

0 

12 

3 

1 

6 

2 

0.846 

0.871 

0.750 

1.000 

0 

0 

11 

0 

4 

5 

1 

0.876 

0.959 

1.000 

1.000 

0 

0 

18 

3 

2 

6 

0 

0.874 

0.931 

0.765 

1.000 

0 

0 

17 

1 

2 

9 

4 

0.879 

0.925 

0.800 

1.000 

0 

0 

3 

0 

0 

4 

1 

0.878 

0.921 

0.744 

1.000 

0 

0 

9 

1 

1 

0 

4 

0.865 

0.912 

0.700 

1.000 

1 

0 

10 

1 

1 

12 

1 

0.868 

0.931 

0.857 

1.000 
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Appendix  BG:  Seymour- Johnson  AFB  Data 


Seymoui  Johnson  |4FW|  Pait-1 


Flight  Homs 

MXG 

2A2W 

Manning 

(rate) 

OA 

Manning 

Effect 

(rate) 

Bieak  (rate) 

Fix 

late) 

Flying 
Scheil 
Effect  (late) 

MX  Scheil 
Effect  (late) 

Aboil  (late) 

IFEs 

late) 

MX 

Devs 

Ops 

count) 

F-15E 

(Op) 

F-15E 

(Tin) 

F-15E 

(Op) 

F-15E 

(Tin) 

F-15E 

(°p) 

F-15E 

(Trn) 

F-15E 

(°pl 

F-15E 

(Tin) 

F-15E 

(Op) 

F-15E 

(Tin) 

F-15E 

(Op) 

F-15E 

(Trn) 

F-15E 

(°pl 

F-15E 

(Tin) 

F-15E 

(Op) 

F-15E 

(Trn) 

Jan  03 

1031.9 

927.2 

0.922 

0.166 

0.222 

0.722 

0.724 

0.628 

0.700 

0.97 

0.97 

0.069 

0.082 

61 

14 

Feb  03 

1733.1 

810.6 

0.922 

0.146 

0.19 

0.679 

0.758 

0.969 

0.905 

0.978 

0.972 

0.047 

0.108 

20 

39 

Mar  03 

5276.1 

979.5 

0.922 

0.185 

0.171 

0.707 

0.822 

0.994 

0.872 

1.000 

0.998 

0.057 

0.115 

8 

47 

A|)i  03 

5523.4 

1048.4 

0.918 

0.149 

0.202 

0.731 

0.756 

0.940 

0.827 

0.667 

0.987 

0.065 

0.106 

76 

39 

May  03 

2425.2 

1053.4 

0.918 

0.212 

0.202 

0.536 

0.756 

0.959 

0.827 

0.967 

0.947 

0.049 

0.106 

13 

39 

Jim  03 

1628.4 

971.9 

0.918 

0.159 

0.205 

0.736 

0.654 

0.825 

0.796 

0.952 

0.968 

0.092 

0.114 

49 

28 

Jill  03 

1418.6 

1096.5 

0.918 

0.169 

0.239 

0.622 

0.685 

0.789 

0.739 

0.907 

0.951 

0.082 

0.119 

64 

75 

Aui|  03 

1006.4 

1167.9 

0.918 

0.126 

0.264 

0.690 

0.741 

0.767 

0.812 

0.951 

0.963 

0.070 

0.081 

83 

45 

Sep  03 

858.5 

923.8 

0.918 

0.139 

0.229 

0.795 

0.758 

0.675 

0.651 

0.928 

0.951 

0.084 

0.129 

28 

43 

Oct  03 

1268.2 

1092.5 

0.918 

0.147 

0.245 

0.762 

0.696 

0.721 

0.757 

0.904 

0.947 

0.082 

0.094 

108 

50 

Nov  03 

1121.4 

806.8 

0.918 

0.13 

0.196 

0.747 

0.650 

0.773 

0.688 

0.947 

0.957 

0.060 

0.156 

67 

73 

Dec  03 

1064.8 

891.2 

0.918 

0.156 

0.162 

0.612 

0.745 

0.698 

0.764 

0.941 

0.977 

0.095 

0.092 

91 

57 

Jan  04 

1023.2 

917.9 

0.794 

0.918 

0.13 

0.194 

0.815 

0.728 

0.634 

0.609 

0.931 

0.973 

0.090 

0.107 

80 

57 

Feb  04 

2407.3 

1124 

0.776 

0.918 

0.163 

0.18 

0.804 

0.770 

0.658 

0.693 

0.938 

0.964 

0.102 

0.084 

75 

29 

Mar  04 

1581.2 

1345.6 

0.799 

0.918 

0.114 

0.204 

0.789 

0.780 

0.871 

0.800 

0.981 

0.966 

0.060 

0.139 

69 

93 

Apr  04 

1373.8 

1156.4 

0.802 

0.918 

0.112 

0.168 

0.806 

0.706 

0.759 

0.757 

0.942 

0.979 

0.073 

0.124 

70 

66 

May  04 

1063.2 

964.9 

0.796 

0.918 

0.145 

0.191 

0.714 

0.694 

0.781 

0.792 

0.88 

0.968 

0.081 

0.105 

69 

47 

Jim  04 

2910.2 

1061 

0.801 

0.918 

0.054 

0.202 

0.542 

0.616 

0.956 

0.879 

0.928 

0.979 

0.051 

0.103 

30 

54 

Jul  04 

2395.6 

1012 

0.806 

0.918 

0.185 

0.221 

0.774 

0.616 

0.830 

0.779 

0.935 

0.966 

0.105 

0.113 

97 

85 

Am)  04 

2407.3 

1124 

0.897 

0.918 

0.197 

0.15 

0.730 

0.655 

0.690 

0.725 

0.909 

0.982 

0.115 

0.099 

81 

60 

Sep  04 

1635 

863.4 

0.890 

0.922 

0.204 

0.159 

0.889 

0.706 

0.646 

0.761 

0.921 

0.972 

0.116 

0.119 

31 

42 

Oct  04 

838.4 

1130.9 

0.888 

0.922 

0.19 

0.138 

0.714 

0.618 

0.825 

0.784 

0.982 

0.986 

0.107 

0.085 

50 

37 

Nov  04 

2158 

1048.9 

0.881 

0.922 

0.177 

0.145 

0.815 

0.690 

0.781 

0.673 

0.973 

0.973 

0.093 

0.096 

40 

48 

Dec  04 

2220.6 

939 

0.883 

0.922 

0.17 

0.181 

0.837 

0.641 

0.780 

0.790 

0.973 

0.973 

0.078 

0.090 

105 

107 
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Seymoiii  Johnson  |4FW|  Pait-2 


MC 

late) 

Repeat 

(rate) 

Recur  (rate) 

TNMCM 

(rate) 

CANN  (rate) 

DOPs 

(count) 

FODs 

(count) 

Combined 

Mishaps 

(count) 

Flight 

Mishaps 

(count) 

Ground 

Mishaps 

(count) 

F-15E 

F-15E 

F-15E 

F-15E 

F-15E 

F-15E 

F-15E 

F-15E 

F-15E 

F-15E 

(0|)| 

fTrn) 

(0|»l 

(Tin) 

(Op) 

(Trn) 

(°|» 

(Tin) 

(Op) 

(Tin) 

0.801 

0.775 

0.023 

0.009 

0.010 

0.008 

0.164 

0.193 

0.136 

0.088 

2 

27 

0 

0 

0 

0.852 

0.752 

0.013 

0.016 

0.010 

0.009 

0.125 

0.188 

0.122 

0.119 

3 

10 

0 

0 

0 

0.783 

0.788 

0.002 

0.013 

0.010 

0.008 

0.173 

0.160 

0.167 

0.111 

1 

12 

0 

0 

0 

0.754 

0.816 

0.014 

0.021 

0.010 

0.008 

0.177 

0.136 

0.238 

0.130 

0 

9 

1 

1 

0 

0.824 

0.816 

0.013 

0.014 

0.009 

0.008 

0.115 

0.136 

0.119 

0.084 

0 

11 

0 

0 

0 

0.798 

0.809 

0.022 

0.022 

0.010 

0.008 

0.142 

0.151 

0.059 

0.108 

0 

13 

1 

1 

0 

0.778 

0.766 

0.03 

0.031 

0.010 

0.008 

0.173 

0.202 

0.105 

0.118 

0 

8 

0 

0 

0 

0.79 

0.772 

0.019 

0.035 

0.010 

0.008 

0.157 

0.199 

0.203 

0.200 

1 

8 

0 

0 

0 

0.83 

0.84 

0.017 

0.018 

0.010 

0.008 

0.118 

0.140 

0.203 

0.164 

4 

13 

1 

0 

1 

0.70 

0.768 

0.027 

0.018 

0.009 

0.008 

0.191 

0.203 

0.148 

0.151 

0 

29 

1 

1 

0 

0.807 

0.751 

0.018 

0.016 

0.010 

0.008 

0.161 

0.217 

0.089 

0.189 

1 

14 

1 

1 

0 

0.824 

0.839 

0.013 

0.021 

0.010 

0.008 

0.131 

0.132 

0.181 

0.110 

0 

24 

1 

1 

0 

0.799 

0.792 

0.012 

0.009 

0.010 

0.008 

0.159 

0.176 

0.197 

0.109 

1 

19 

0 

0 

0 

0.785 

0.809 

0.024 

0.016 

0.010 

0.008 

0.156 

0.142 

0.249 

0.095 

1 

25 

0 

0 

0 

0.813 

0.801 

0.012 

0.022 

0.010 

0.008 

0.139 

0.172 

0.136 

0.118 

2 

16 

0 

0 

0 

0.833 

0.798 

0.019 

0.031 

0.010 

0.008 

0.117 

0.154 

0.195 

0.070 

0 

18 

0 

0 

0 

0.793 

0.817 

0.009 

0.054 

0.010 

0.008 

0.164 

0.154 

0.201 

0.045 

1 

20 

0 

0 

0 

0.765 

0.788 

0.017 

0.03 

0.010 

0.008 

0.175 

0.180 

0.118 

0.058 

0 

24 

0 

0 

0 

0.771 

0.792 

0.025 

0.04 

0.010 

0.008 

0.165 

0.171 

0.256 

0.080 

0 

26 

0 

0 

0 

0.756 

0.786 

0.027 

0.03 

0.010 

0.008 

0.182 

0.198 

0.246 

0.087 

0 

21 

2 

2 

0 

0.803 

0.845 

0.025 

0.023 

0.010 

0.008 

0.126 

0.121 

0.327 

0.051 

0 

19 

2 

1 

1 

0.773 

0.822 

0.031 

0.016 

0.010 

0.008 

0.152 

0.141 

0.189 

0.077 

0 

13 

1 

1 

0 

0.776 

0.841 

0.016 

0.016 

0.010 

0.008 

0.159 

0.113 

0.128 

0.102 

1 

20 

0 

0 

0 

0.799 

0.843 

0.025 

0.029 

0.010 

0.008 

0.141 

0.137 

0.168 

0.137 

2 

14 

1 

0 

1 
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Seymour-Johnson  (4F\ 

/V)  Part-3 

STVs 

(count) 

DSVs 

(count) 

TDVs 

(count) 

DRs 

Sub 

(count) 

TO  Imp 
Sub 
(count) 

QVI 

Pass 

(rate) 

KTL 

Pass 

(rate) 

Phase 

KTL 

(rate) 

PE 

Pass 

(rate) 

6 

3 

1 

41 

7 

0.869 

0.961 

5 

1 

2 

29 

8 

0.840 

0.897 

8 

0 

3 

41 

14 

0.826 

0.982 

3 

0 

2 

21 

12 

0.839 

0.946 

4 

0 

2 

26 

16 

0.840 

0.985 

12 

0 

7 

22 

0 

0.796 

0.971 

17 

3 

10 

17 

11 

0.799 

0.975 

18 

1 

12 

29 

10 

0.799 

0.932 

16 

0 

11 

41 

10 

0.807 

0.979 

31 

4 

15 

44 

18 

0.814 

0.978 

18 

3 

6 

41 

13 

0.834 

0.955 

12 

0 

9 

37 

6 

0.794 

0.964 

9 

1 

7 

36 

13 

0.829 

0.941 

8 

0 

5 

40 

9 

0.785 

0.943 

19 

3 

6 

58 

12 

0.827 

0.920 

11 

3 

4 

41 

21 

0.853 

0.955 

15 

2 

6 

45 

3 

0.830 

0.936 

40 

7 

8 

39 

18 

0.756 

0.878 

22 

2 

8 

26 

22 

0.796 

0.908 

17 

1 

9 

29 

14 

0.822 

0.932 

23 

1 

8 

27 

11 

0.849 

1.000 

8 

0 

1 

19 

10 

0.822 

0.936 

15 

4 

8 

20 

25 

0.846 

0.943 

18 

1 

12 

13 

6 

0.835 

0.966 
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Appendix  BH:  Shaw  AFB  Data 


Shaw  AFB  (20th  MXG 

Part-1 

Flight 

Homs 

MXG 

2A2W 

Manning 

OA 

Manning 

Effect 

(late) 

Bieak 

(rate) 

Fix 

(late) 

Flying 

Scheil 

Effect 

(rate) 

MX 

Scheil 

Effect 

(rate) 

Abort 

(rate) 

IFEs 

(rate) 

MX/Ops 

Devs 

(count) 

MC 

(rate) 

Repeat 

(late) 

Recur 

(rate) 

TNMCM 

(rate) 

CANN 

(rate) 

DOPs 

(count) 

FODs 

(count) 

Combined 

Mishaps 

(count) 

Jan  03 

2204.0 

0.967 

0.143 

0.797 

0.821 

0.985 

0.059 

0.005 

42 

0.832 

0.023 

0.025 

0.120 

0.102 

0 

0 

0 

Fell  03 

2205.6 

0.967 

0.155 

0.726 

0.859 

0.970 

0.048 

0.000 

57 

0.860 

0.017 

0.011 

0.102 

0.074 

0 

0 

0 

Mar  03 

3745.8 

0.967 

0.196 

0.883 

0.875 

0.971 

0.054 

0.001 

52 

0.855 

0.029 

0.036 

0.097 

0.119 

0 

2 

0 

Apr  03 

2080.5 

0.967 

0.185 

0.766 

0.857 

0,950 

0.065 

0.005 

48 

0.828 

0.025 

0.045 

0.112 

0.136 

1 

1 

1 

May  03 

1772.6 

0.967 

0.159 

0.772 

0.817 

0.953 

0.054 

0.008 

61 

0.838 

0.034 

0.009 

0.115 

0.120 

0 

2 

0 

Jim  03 

2099.4 

0.967 

0.148 

0.818 

0.875 

0.954 

0.048 

0.006 

45 

0.842 

0.026 

0.033 

0.089 

0.108 

1 

0 

0 

Jul  03 

2282.4 

0.967 

0.114 

0.771 

0.882 

0.934 

0.049 

0.006 

63 

0.843 

0.028 

0.018 

0.106 

0.091 

1 

0 

2 

Alii)  03 

1971.9 

0.967 

0.114 

0.775 

0.889 

0.970 

0.034 

0.004 

33 

0.831 

0.010 

0.005 

0.100 

0.112 

0 

0 

0 

Sep  03 

1640.9 

0.967 

0.158 

0.815 

0.918 

0.981 

0.052 

0.002 

27 

0.881 

0.009 

0.013 

0.076 

0.105 

0 

0 

0 

Oct  03 

2708.5 

0.967 

0.138 

0.835 

0.864 

0.855 

0.056 

0.003 

75 

0.830 

0.010 

0.014 

0.116 

0.098 

0 

1 

0 

Nov  03 

2010.6 

0.967 

0.121 

0.878 

0.907 

0.990 

0.050 

0.006 

41 

0.864 

0.018 

0.016 

0.081 

0.068 

0 

1 

0 

Dec  03 

1688.6 

0.967 

0.130 

0.904 

0.849 

0.986 

0.046 

0.002 

41 

0.883 

0.008 

0.021 

0.074 

0.069 

0 

1 

0 

Jan  04 

1726.1 

0.860 

0.967 

0.119 

0.879 

0.772 

0.971 

0.040 

0.003 

31 

0.875 

0.017 

0.015 

0.078 

0.049 

0 

1 

0 

Feb  04 

2169.6 

0.872 

0.967 

0.108 

0.835 

0.888 

0.963 

0.046 

0.003 

48 

0.837 

0.010 

0.020 

0.117 

0.053 

0 

3 

0 

Mar  04 

2225.9 

0.887 

0.967 

0.112 

0.780 

0.893 

0.964 

0.054 

0.009 

45 

0.824 

0.028 

0.007 

0.123 

0.075 

0 

1 

1 

Api  04 

1840.4 

0.870 

0.967 

0.095 

0.835 

0.927 

0.985 

0.041 

0.004 

34 

0.852 

0.010 

0.030 

0.096 

0.054 

0 

0 

0 

May  04 

1867.3 

0.869 

0.967 

0.101 

0.862 

0.934 

0,938 

0.053 

0.012 

42 

0.851 

0.018 

0.022 

0.088 

0.073 

0 

1 

0 

Jim  04 

1526.0 

0.866 

0.967 

0.129 

0.746 

0.811 

0.938 

0.078 

0.011 

72 

0.836 

0.026 

0.026 

0.108 

0.081 

0 

1 

1 

Jul  04 

1534.2 

0.849 

1.000 

0.128 

0.784 

0.868 

0.926 

0.058 

0.006 

40 

0.838 

0.021 

0.010 

0.108 

0.070 

0 

0 

2 

Aik]  04 

1600.3 

0.952 

1.000 

0.114 

0.742 

0.811 

0.969 

0.061 

0.002 

55 

0.822 

0.005 

0.014 

0.116 

0.087 

0 

1 

2 

Sep  04 

1534.5 

0.935 

1.000 

0.115 

0.733 

0.851 

0.977 

0.069 

0.004 

32 

0.889 

0.013 

0.019 

0.069 

0.060 

0 

1 

0 

Oct  04 

2117.0 

0.934 

1.000 

0.125 

0.861 

0.834 

0,966 

0.065 

0.010 

52 

0.858 

0.002 

0.019 

0.094 

0.061 

0 

0 

1 

Nov  04 

2086.1 

0.923 

1.000 

0.127 

0.824 

0.889 

0.980 

0.053 

0.007 

41 

0.866 

0.018 

0.020 

0.088 

0.043 

0 

1 

0 

Dec  04 

2059.5 

0.925 

1.000 

0.114 

0.816 

0.896 

0.978 

0.057 

0.009 

56 

0.862 

0.008 

0.006 

0.092 

0.067 

0 

1 

0 

222 


Shaw  AFB  (20th  MXG)  Pait-2 


Flight 

Mishaps 

{count) 

Gioimd 

Mishaps 

{count) 

STVs 

{count) 

DSVs 

(count) 

TDVs 

(count) 

DRs  Suh 
(count) 

TO  Imp 
Suh 
(count) 

OVI  Pass 
(rate) 

KTL 

Pass 

(rate) 

Phase 

KTL 

(rate) 

PE 

Pass 

(rate) 

0 

0 

30 

7 

4 

20 

0.903 

0.877 

0.714 

1.000 

0 

0 

9 

1 

2 

11 

0.900 

0.915 

0.750 

1.000 

0 

0 

14 

1 

1 

12 

0.909 

0.940 

0.600 

1.000 

1 

0 

8 

1 

1 

27 

0.903 

0.933 

0.600 

1.000 

0 

0 

15 

1 

2 

24 

0.920 

0.944 

0.833 

0.944 

0 

0 

17 

3 

3 

31 

0.906 

0.914 

0.667 

1.000 

0 

2 

1G 

1 

1 

17 

0.932 

0.955 

0.800 

1.000 

0 

0 

7 

2 

1 

17 

0.916 

0.908 

0.778 

1.000 

0 

0 

11 

0 

2 

15 

13 

0.919 

0.952 

1.000 

1.000 

0 

0 

8 

0 

0 

32 

14 

0.930 

0.929 

0.667 

0.957 

0 

0 

9 

1 

0 

11 

6 

0.928 

0.940 

0.667 

0.955 

0 

0 

7 

1 

0 

16 

6 

0.931 

0.944 

1.000 

1.000 

0 

0 

22 

5 

2 

16 

17 

0.905 

0.927 

0.500 

0.960 

0 

0 

13 

2 

5 

16 

16 

0.925 

0.955 

0.750 

1.000 

1 

0 

23 

2 

2 

15 

18 

0.919 

0.955 

1.000 

0.984 

0 

0 

17 

2 

2 

25 

16 

0.909 

0.970 

1.000 

0.932 

0 

0 

18 

5 

4 

11 

6 

0.911 

0.911 

0.833 

0.960 

0 

1 

25 

4 

1 

22 

12 

0.925 

0.959 

0.833 

0.983 

2 

0 

22 

12 

2 

20 

5 

0.940 

0.978 

0.750 

0.991 

0 

2 

7 

3 

2 

15 

12 

0.916 

0.902 

0.714 

0.984 

0 

0 

14 

4 

4 

8 

9 

0.924 

0.885 

0.750 

0.980 

1 

0 

11 

5 

1 

19 

10 

0.911 

0.926 

1.000 

0.990 

0 

0 

15 

6 

4 

9 

7 

0.916 

0.969 

0.500 

0.977 

0 

0 

11 

2 

2 

21 

19 

0.922 

0.970 

1.000 

1.000 
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Appendix  BI:  Whiteman  AFB  Data 


Whiteman  (509BW)  Pait-1 

Flight 

Homs 

MX6 

2A2W 

Maiming 

OA 

Manning 
Effect  (late) 

Bieak 

(late) 

Fix 

(late) 

Flying 

Sclieil 

Effect 

(late) 

MX 

Sclieil 

Effect 

(late) 

Abort 

(late) 

IFEs 

(rate) 

MX  Ops 
Devs 
(count) 

MC 

(late) 

Repeat 

(rate) 

Recur 

(rate) 

TNMCM 

(late) 

CANN 

(late) 

DOPs 

(count) 

FODs 

(count) 

Combined 

Mishaps 

(count) 

Jan  03 

526 

0.850 

0.107 

0.385 

0.540 

0.864 

0.055 

16 

0.263 

0.008 

0 

033 

0.737 

0.098 

3 

7 

0 

Felt  03 

304.7 

0.850 

0.065 

0.400 

0.443 

0.955 

0.025 

27 

0.327 

0.045 

0 

030 

0.673 

0.130 

3 

3 

1 

lvl.il  03 

1340.7 

0.850 

0.082 

0.222 

0.620 

0.951 

0.036 

10 

0.630 

0.022 

0 

023 

0.369 

0.100 

3 

4 

1 

Apr  03 

749.3 

0.850 

0.081 

0.250 

0.766 

0.957 

0.058 

7 

0.633 

0.047 

0 

037 

0.356 

0.081 

1 

2 

0 

May  03 

604.5 

0.850 

0.174 

0.696 

0.773 

0.799 

0.022 

13 

0.454 

0.016 

0 

087 

0.537 

0.114 

1 

1 

0 

Jim  03 

561.1 

0.850 

0.085 

0.500 

0.632 

0.866 

0.049 

21 

0.486 

0.032 

0 

042 

0.514 

0.077 

1 

5 

0 

Jul  03 

674.6 

0.850 

0.108 

0.769 

0.846 

0.783 

0.071 

11 

0.417 

0.021 

0 

021 

0.583 

0.100 

0 

8 

0 

Aug  03 

548.9 

0.850 

0.054 

0.677 

0.709 

0.925 

0.009 

7 

0.375 

0.012 

0 

060 

0.618 

0.036 

2 

6 

0 

Sep  03 

508 

0.884 

0.059 

0.800 

0.703 

0.954 

0.023 

4 

0.478 

0.031 

0 

062 

0.522 

0.118 

3 

2 

0 

Oct  03 

53(1.3 

0.884 

0.063 

0.750 

0.725 

0.870 

0.066 

11 

0.537 

0.000 

0 

036 

0.459 

0.070 

0 

2 

0 

Nov  03 

560,3 

0.884 

0.079 

0.778 

0.732 

0.980 

0.050 

11 

0.530 

0.023 

0 

035 

0.444 

0.009 

0 

4 

0 

Dec  03 

352,5 

0.884 

0.064 

0.400 

0.567 

1.000 

0.085 

19 

0.520 

0.000 

0 

000 

0.472 

0.026 

2 

4 

2 

Jan  0J 

499.8 

0.834 

0.921 

0.147 

0.667 

0.593 

1.000 

0.075 

28 

0.500 

0.011 

0 

on 

0.492 

0.020 

0 

5 

0 

Fell  0J 

530.2 

0.824 

0.921 

0.126 

0.357 

0.617 

0.995 

0.069 

18 

0.293 

0.010 

0 

000 

0.707 

0.027 

2 

4 

0 

Mai  04 

670.6 

0.818 

0.921 

0.179 

0.500 

0.717 

0.979 

0.055 

19 

0.394 

0.029 

0 

044 

0.606 

0.057 

1 

3 

0 

Apt  04 

572.9 

0.952 

0.921 

0.083 

0.364 

0,556 

0.990 

0.044 

44 

0.424 

0.000 

0 

000 

0.576 

0.038 

2 

8 

0 

May  04 

532.9 

0.952 

0.921 
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Appendix  BK-1 :  Barksdale  AFB  QA  Manning  Calculations  for  2003 
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Appendix  BL-1 :  Beale  AFB  QA  Manning  Calculations  for  2003 
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Appendix  BL-2:  Beale  AFB  QA  Manning  Calculations  for  2004 
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Effectiveness 


Appendix  BM-1 :  Cannon  AFB  QA  Manning  Calculations  for  2003 
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Appendix  BM-2:  Cannon  AFB  QA  Manning  Calculations  for  2004 
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Appendix  BN-1 :  Davis-Monthan  AFB  QA  Manning  Calculations  for  2003 
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Appendix  BN-2:  Davis-Monthan  AFB  QA  Manning  Calculations  for  2004 
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Appendix  BO-2:  Dyess  AFB  QA  Manning  Calculations  for  2004 
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Appendix  BP-1 :  Ellsworth  AFB  QA  Manning  Calculations  for  2003 
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Appendix  BP-2:  Ellsworth  AFB  QA  Manning  Calculations  for  2004 
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Appendix  BQ-1 :  Holloman  AFB  QA  Manning  Calculations  for  2003 
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Appendix  BQ-2:  Holloman  AFB  QA  Manning  Calculations  for  2004 
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Appendix  BR-1 :  Langley  AFB  QA  Manning  Calculations  for  2003 
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Appendix  BR-2:  Langley  AFB  QA  Manning  Calculations  for  2004 
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Appendix  BS-1 :  Minot  AFB  QA  Manning  Calculations  for  2003 
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Appendix  BS-2:  Minot  AFB  QA  Manning  Calculations  for  2004 
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Appendix  BT-1 :  Mountain  Home  AFB  QA  Manning  Calculations  for  2003 
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Appendix  BT-2:  Mountain  Home  AFB  QA  Manning  Calculations  for  2004 
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Appendix  BU-1 :  Nellis  AFB  QA  Manning  Calculations  for  2003 
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Appendix  BV-1 :  Offutt  AFB  QA  Manning  Calculations  for  2003 
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Appendix  BV-2:  Offutt  AFB  QA  Manning  Calculations  for  2004 
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Appendix  BW:  Pope  AFB  QA  Manning  Calculations  for  2004 
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Appendix  BX-1 :  Seymour- Johnson  AFB  QA  Manning  Calculations  for  2003 
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Appendix  BX-2:  Seymour- Johnson  AFB  QA  Manning  Calculations  for  2004 
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Appendix  BY-1 :  Shaw  AFB  QA  Manning  Calculations  for  2003 
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Appendix  BY-2:  Shaw  AFB  QA  Manning  Calculations  for  2004 
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Effectiveness 


Appendix  BZ-1 :  Whiteman  AFB  QA  Manning  Calculations  for  2003 
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Appendix  BZ-2:  Whiteman  AFB  QA  Manning  Calculations  for  2004 
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Appendix  CA:  Survey,  Part-1  Results  w/  Validation 
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Assurance  personnel. 

56.5% 

4.0 

V 

08 

4|4  |4|5|5|2|  5  |4|3|4|5|4|4|1 |4|4|5|4|2|1 |5|4|6|2|5|4|4|5|4|4|4|4|3|2 

3.82 

56.5% 

1.19 

1.42 

0.31 

Off 

Ratings 

Mean 

Effect 

Rating 

Std  Dev 

Var 

Coeff  of 
Vat 

09:  ACC  aircraft  unit  winy  Aircraft  Class-C  Mishaps  rates  are  affected  by  the  quality  of  work  performed  by  aircraft  maintenance  Ouality 
Assurance  personnel. 

57.1% 

4.0 

V 

09 

4 1  4  1 4 1 5 1 5 1 2 1  5  |4|3|4|5|4|4|1 |4|4|5|4|2|1 |4|4|6|2|5|5|4|5|4|4|4|5|3|2 

3.85 

57.1% 

1.21 

1.46 

0.31 

0" 

Ratings 

Mean 

Effect 

Rating 

Std  Dev 

Var 

Coeff  of 
Var 

010:  ACC  aircraft  unit  winy  Maintenance  Personnel  Training  pass  rates  are  affected  by  the  quality  of  work  performed  by  aircraft 
maintenance  Quality  Assurance  personnel. 

61.8% 

4.0 

V 

010 

6|4  |4|6|4|5|6  | 3 | 5 | 4 | 4 | B | 2 | 3 | 2 | 4 | 3 | 5 | 2 | 4 | 5 | 4 | 6 | 5 | 5 | 4 | 4 | 5 | 2 | 1 | B | 3 | 3 | 4 

4.09 

61.8% 

1.36 

1.84 

0.33 

Off 

Ratings 

Mean 

Effect 

Rating 

Std  Dev 

Var 

Coeff  of 
Vat 

Oil:  ACC  aircraft  unit  winy  Phase  Dock  Inspection  pass  rates  are  affected  by  the  quality  of  work  performed  by  aircraft  maintenance 

Ouality  Assurance  personnel. 

75.3% 

5.0 

V 

Oil 

6|3  |5|6|6|5|6  |4|5|4|5|6|2|3|5|5|4|4|5|5|6|4|6|5|6|6|5|5|3|5|B|6|3|2 

4.76 

75.3% 

1.21 

1.46 

0.25 

Off 

Ratings 

Mean 

Effect 

Rating 

Std  Dev 

Var 

Coeff  of 
Vat 

012:  ACC  aircraft  unit  winy  Repeat  rates  are  affected  by  the  quality  of  work  performed  by  aircraft  maintenance  Ouality  Assurance 
personnel. 

51.2% 

4.0 

V 

012 

3|3  |5|5|4|2|3  |3 1 2 1 3 1 4 1 4 1 2 1 5 1 4 1 4 1 1  1 4 1 2 1 1  1 4 1 4 1 6 1 2 1 4 1 5 1 4 1 5 1 3 1 4 1 5 1 4 1 3 1 4 

3.56 

51.2% 

1.21 

1.47 

0.34 

Off 

Ratings 

Mean 

Effect 

Rating 

Std  Dev 

Vat 

Coeff  of 
Var 

013:  AC 

personn 

:C  aircraft  unit  wing  Recrtr  rates  are  affected  by  the  quality  of  work  performer 

el. 

by  aircraft  maintenance  Ouality  Assurance 

50.6% 

4.0 

V 

013 

3|3  |5|5|4|2| 3  |3|2|3|3|4|2|5|4|4|1 |4|2|1 |4|4|6|2|5|4|4|5|4|4|4|4|3|4 

3.53 

50.6% 

1.19 

1.41 

0.34 

Off 

Ratings 

Mean  1 

Effect 

Rating 

Std  Dev  1 

Vat 

Coeff  of 
Vat 

014:  ACC  aircraft  unit  winy  Late  Takeoff  rates  are  affected  by  the  quality  of  work  performed  by  aircraft  maintenance  Ouality  Assurance 
personnel. 

38.8% 

3.0 

NV 

014 

2|3  1 3 | 5 | 4 | 2 | 3  |3|2|3|3|4|5|5|2|3|1 | 4 | 2 | 1 j  1 1 3 | 6 | 2 | 1 |2|2|5|3|2|4|5|2]2 

2.94 

38.8% 

1.35 

1.81 

0.46 

Off 

Ratings 

Mean  1 

Effect 

Rating 

Std  Dev  1 

Var 

Coeff  of 
Var 

015:  ACC  aircraft  unit  winy  Safety  rates  ate  affected  by  the  quality  of  work  performed  by  aircraft  maintenance  Ouality  Assurance 
personnel. 

71.8% 

5.0 

V 

015 

4  |  5  1 5 1 6 1 6 1 3 1  6  |4|4|4|3|5|4|5|5|4|3|4|5|5|4|5|6|5|6|4|4|5|4|5|6|5|3|4 

4.59 

71.8% 

0.92 

0.86 

0.20 

Off 

Ratings 

Mean  1 

Effect  1 
Rating 

Std  Dev  1 

Var 

Coeff  of 
Vat 

016:  ACC  aircraft  unit  winy  HHO  Inspection  (i.e.  IG.  LOCAT.  ESHOCAMP.  SAVs.  etc.)  pass  rates  are  affected  by  the  quality  of  work 
performed  by  aircraft  maintenance  Ouality  Assurance  personnel. 

81.2% 

5.0 

V 

016 

1 4 1  5  1 6 1 G 1 6 1 5 1  6  |4|3|4|5|5|6|5|6|4|5|4|5|5|6|6|4|5|6|5|5|5|5|6|6|5|3|6|  I  5.06 

I  81.2% 

|  0.89 

I  0.78 

1 °-18  i 
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Appendix  CB:  Survey,  Part-1  Results,  Fill-In  w/  Validation 


0°  | Fill-In  Ratings 


017  018  019:  ACC  aiicraft  unit  wing _ rates  are  affected  by  the  guality  of  work  perfoimed  by  aircraft  maintenance  Quality  Assurance  personnel. 


Rating 

Metric 

%  Affected  by  OA 

Median 

If  2d  Ouartile  >  50%=V  (Valid), 
ow/  NV  (Not  Valid) 

6 

Key  Task  list 

90% 

5.5 

V 

5 

KTL 

6 

Quality  Verification  Inspections 

100% 

5.0 

V 

5 

Flying  Scheduling  Effectiveness 

80% 

6.0 

V 

4 

mission  capable 

4 

MC  rates 

70% 

4.0 

4 

mission  capable 

5 

MC  rates 

5 

8  hour  fix 

4 

8  12  horn  fix  late 

5.0 

V 

6 

12  hi  fix  rates 

5 

Fix  rates 

5 

Deficiency  reporting  rate 

80% 

5.0 

V 

5 

Cruise  Missile  Availability  Rate 

80% 

5.0 

V 

2 

cut  tires 

20% 

2.0 

NV 

6 

ORI 

100% 

6.0 

V 

6 

Donor  aircraft 

100% 

6.0 

V 

5 

TNMCM 

80% 

5.0 

V 

5 

technical  order  compliance 

80% 

5.0 

V 

5 

technical  older  impiovement  initiatives 

80% 

5.0 

V 

Appendix  CC:  Regression  for  QA  Manning  Effectiveness  and  Break  Rate 


Dependent  Variable:  LOGjlOO'BREAKl 

Method:  Least  Squares 

Date:  03/17/05  Time:  12:32 

Sample:  1  400  IF  B2=0 

Included  observations:  348 

White  Heteroskedasticity-Consistent  Standard  Errors  &  Covariance 

Variable 

Coefficient 

Std.  Error 

t-Statistic 

Piol). 

C 

4.17838 

0.278083 

15.02567 

0 

100‘QAMANNI 

41.008314 

0.003349 

-2.482781 

0.0135 

FIGHTER 

-0.939144 

0.075903 

-12.3729 

0 

SPECIAL 

-1.235644 

0.094082 

-13.1337 

0 

R-squared 

0.454402 

Mean  dependent  var 

2.743067 

Adjusted  R-squaied 

0.449644 

S.D.  dependent  var 

0.631322 

S.E.  of  reqression 

0.468352 

Akaike  info  criterion 

1 .332236 

Sum  squared  resid 

75.45773 

Schwarz  criterion 

1  376514 

Loq  likelihood 

-227.809 

F-statistic 

95.50027 
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Appendix  CD:  Regression  for  QA  Manning  Effectiveness  and  CANN  Rate 


Dependent  Variable:  LOG(100‘CANN 

Method:  Least  Squares 

Date:  03/17/05  Time:  12:34 

Sample:  1  400  IF  B2  =  0 

Included  observations:  348 

White  Heteroskedasticity-Consistent  Standard  Errors  &  Covariance 

Variable 

Coefficient 

Std.  Enor 

t-Statistic 

Piob. 

C 

6.264102 

0.617573 

10.1431 

0 

100‘QAMANNI 

-0.02647 

0.006767 

-3.911597 

0.0001 

FIGHTER 

-1.775096 

0.07899 

-22.47253 

0 

SPECIAL 

-3.17734 

0.243735 

-13.03602 

0 

R-squared 

0.615017 

Mean  dependent  var 

2.510841 

Adjusted  R-sqnaied 

0.61 166 

S.D.  dependent  var 

1.137491 

S.E.  ofreqression 

0.708849 

Akaike  info  criterion 

2.16108 

Sum  squared  resid 

172.8488 

Schwarz  criterion 

2.205358 

Log  likelihood 

-372  028 

F-statistic 

183  1823 

Durbin-Watson  stat 

0.50671 

Prob(F-statistic) 

0 

Appendix  CE:  Regression  for  QA  Manning  Effectiveness  and  DOP  Count 


Dependent  Variable:  DOP 

Method:  ML/QML-  Poisson  Count  (Quadratic  hill  climbinq) 

Date:  03/17/05  Time:  12:34 

Sample  (adjusted):  1  384 

Included  observations:  372  after  adjustments 

Converqence  achieved  after  5  iterations 

QML  (Huber/White)  standard  errors  &  covariance 

Variable 

Coefficient 

Std.  Error 

z -Statistic 

Prob. 

C 

2.080573 

0.623371 

3.337616 

0.0008 

100‘QAMANNI 

•0.01058 

0.006675 

-1.585147 

0.1129 

FIGHTER 

-0.825581 

0.124662 

-6.622577 

0 

SPECIAL 

-1 .975846 

0.338648 

-5.834512 

0 

R-squared 

0.14663 

Mean  dependent  var 

1 .822581 

Adjusted  R-squaied 

0.139673 

S.D.  dependent  var 

2.390621 

S.E.  of  regression 

2.217392 

Akaike  info  criterion 

3.86131 

Sum  squared  resid 

1809.393 

Schwarz  criterion 

3.903449 

Log  likelihood 

-714.2037 

Hannan-Quinn  criter. 

3.878044 

Restr.  loq  likelihood 

-800.1408 

Avq.  loq  likelihood 

-1.919902 

LR  statistic  (3  df) 

1  72E+02 

LR  index  (Pseudo-R2) 

0.107403 
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Appendix  CF:  Regression  for  QA  Manning  Effectiveness  and  FSE  Rate 


Dependent  Variable:  LOG|100‘FSE| 

Method:  Least  Squares 

Date:  03/17/05  Time:  12:36 

Sample:  1  400  IF  B2=0 

Included  observations:  348 

White  Heteroskedasticitv-Consistent  Standard  Errors  &  Covariance 

Variable 

Coefficient 

Std.  Ei ioi 

t-Statistic 

Piob. 

C 

4.430337 

0.096676 

45.82686 

0 

100‘QAMANNI 

-0.003558 

0.001165 

-3.053087 

0.0024 

FIGHTER 

0.260302 

0.035266 

7.381124 

0 

SPECIAL 

0.18321 

0.03986 

4.596377 

0 

R-squared 

0.237439 

Mean  dependent  var 

4.302517 

Adjusted  R-s(|iiared 

0.230788 

S.D.  dependent  var 

0.253688 

S.E.  of  regression 

0.222496 

Akaike  info  criterion 

-0.156385 

Sum  squared  resid 

17.02958 

Schwarz  criterion 

-0.112107 

Log  likelihood 

31.21101 

F-statistic 

35.70372 

Durbin-Watson  stat 

1.632206 

Prob(F-statistic) 

0 

Appendix  CG:  Regression  for  QA  Manning  Effectiveness  and  KTL  Pass  Rate 


Dependent  Variable:  LOG 

100‘KTLPASS) 

Method:  Least  Squares 

Date:  03/17/05  Time:  12:36 

Sample:  1  400  IF  B2=0 

Included  observations:  312 

White  Heteroskedasticitv-Consistent  Standard  Errors  &  Covariance 

Variable 

Coefficient 

Std.  Error 

t-Statistic 

Piob. 

C 

4.640279 

0.068834 

67.41267 

0 

100'QAMANNI 

-0.001385 

0.000742 

-1.867712 

0.0628 

FIGHTER 

-0.035739 

0.011959 

-2.988606 

0.003 

SPECIAL 

-0.030501 

0.024361 

-1.252011 

0.2115 

R-squared 

0.058592 

Mean  dependent  var 

4.497526 

Adjusted  R-s(|iiared 

0.049422 

S.D.  dependent  var 

0.083941 

S.E.  of  regression 

0.08184 

Akaike  info  criterion 

-2.155356 

Sum  squared  resid 

2.062933 

Schwarz  criterion 

-2.107369 

Log  likelihood 

340.2356 

F-statistic 

6.389833 

Durbin-Watson  stat 

1 .24087 

Prob(F-statistic) 

0.000327 

270 


Appendix  CH:  Regression  for  QA  Manning  Effectiveness  and  MSE  Rate 


Dependent  Variable:  LOG|100‘MSE 

Method:  Least  Squares 

Date:  03/17/05  Time:  12:37 

Sample:  1  400  IF  B2=0 

Included  observations:  348 

White  Heteroskedasticity-Consistent  Standard  Errors  &  Covariance 

Variable 

Coefficient 

Std.  Error 

t-Statistic 

Prol). 

C 

4.748972 

0.029954 

158.5413 

0 

100  0AMANNI 

-0.002095 

0.000339 

-6.1744 

0 

FIGHTER 

0.002535 

0.005563 

0.455772 

0.6488 

SPECIAL 

-0.079813 

0.016268 

-4.906287 

0 

R-squared 

0.109202 

Mean  dependent  var 

4.559457 

Adjusted  R-squaied 

0.101434 

S.D.  dependent  var 

0.056189 

S.E.  of  repression 

0.053263 

Akaike  info  criterion 

-3.015717 

Sum  squared  resid 

0.975914 

Schwarz  criterion 

-2.971439 

Log  likelihood 

528.7348 

F-statistic 

14.05694 

Durbin-Watson  stat 

1.280335 

Prob(F-statistic) 

0 

Appendix  CE  Regression  for  QA  Manning  Effectiveness  and  QVI  Pass  Rate 


Dependent  Variable:  LOG(100‘QVIPASS) 

Method:  Least  Squares 

Date:  03/17/05  Time:  12:37 

Sample  (adjusted):  1  384 

Included  observations:  365  after  adjustments 

White  Heteroskedasticitv-Consistent  Standard  Errors  &  Covariance 

Variable 

Coefficient 

Std.  Error 

t-Statistic 

Piob. 

C 

4.62219 

0.025762 

179.4163 

0 

100OAMANN1 

-0.001238 

0.000293 

4.231535 

0 

FIGHTER 

-0.020465 

0.005103 

-4.01058 

0.0001 

SPECIAL 

0.001102 

0.008372 

0.131653 

0.8953 

R-squared 

0.182803 

Mean  dependent  var 

4.50452 

Adjusted  R-squaied 

0.176011 

S.D.  dependent  var 

0.045217 

S.E.  of  regression 

0.041046 

Akaike  info  criterion 

-3.537367 

Sum  squared  resid 

0.608192 

Schwarz  criterion 

-3.494628 

Log  likelihood 

649.5695 

F-statistic 

26.91791 

Durbin-Watson  stat 

0.83104 

Prob(F-statistic) 

0 
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Appendix  CJ:  Regression  for  QA  Manning  Effectiveness  and  Repeat  Rate 


Dependent  Variable:  LOG 

100‘QVIPASS) 

Method:  Least  Squares 

Date:  03/17/05  Time:  12:37 

Sample  (adjusted):  1  384 

Included  observations:  365  after  adjustments 

White  Heteroskedasticity-Consistent  Standard  Errors  &  Covariance 

Variable 

Coefficient 

Std.  Eiror 

t-Statistic 

Piob. 

C 

4.62219 

0.025762 

179.4163 

0 

100‘QAMANNI 

-0.001238 

0.000293 

4.231535 

0 

FIGHTER 

-0.020465 

0.005103 

-4.01058 

0.0001 

SPECIAL 

0.001102 

0.008372 

0.131653 

0.8953 

R-squared 

0.182803 

Mean  dependent  var 

4.50452 

Adjusted  R-squaied 

0.176011 

S.D.  dependent  var 

0.045217 

S.E.  ofreqression 

0.041046 

Akaike  info  criterion 

-3.53737 

Sum  squared  resid 

0.608192 

Schwarz  criterion 

-3.49463 

Log  likelihood 

649.5695 

F-statistic 

26  91791 

Durbin-Watson  stat 

0.83104 

Prob(F-statistic) 

0 

Appendix  CK:  Regression  for  QA  Manning  Effectiveness  and  STY  Count 


Dependent  Variable:  STV 

Method:  ML/QML-  Poisson  Count  (Quadratic  hill  climbinq) 

Date:  03/17/05  Time:  12:38 

Sample:  1  400  IF  B2  =0 

Included  observations:  338 

Converqence  achieved  after  5  iterations 

QML  (Huber/White)  standard  errors  &  covariance 

Variable 

Coefficient 

Std.  Error 

z -Statistic 

Piob. 

C 

0.091283 

0.448298 

0.203621 

0.8386 

QAMANN1 

2.479759 

0.501996 

4.939795 

0 

FIGHTER 

0.220037 

0.099749 

2.205909 

0.0274 

SPECIAL 

0.181072 

0.186595 

0.970402 

0.3318 

R-squared 

0.132606 

Mean  dependent  var 

11.18935 

Adjusted  R-squaied 

0.124815 

S.D.  dependent  var 

8.174267 

S.E.  of  regression 

7.647135 

Akaike  info  criterion 

8.814526 

Sum  squared  resid 

19531.88 

Schwarz  criterion 

8.859769 

Loq  likelihood 

-1485.655 

Hannan-Quinn  criter. 

8.832557 

Restr.  loq  likelihood 

-1613.39 

Avq.  loq  likelihood 

-4.395429 

LR  statistic  (3  df) 

255.4695 

LR  index  (Pseudo-R2) 

0.079172 

ProbabilitYfLR  stat) 

0 
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Appendix  CL:  AFSC  Job  Descriptions  (3-sheets) 


AFSC 

AFS  Title 

Job  Descriptions 

AFSCs 

Shreds 

2A0X1 

MONICS  TST  STA  AND  COMP  JYMN/CRFTMI' 

These  personnel  perform  and  manage  avionics  test 
station  functions  and  activities  They  operate,  inspect, 
maintain,  program,  and  calibrate  computer  and 
manually  operated  avionics  test  equipment,  support 
equipment,  and  aircraft  avionics  system  components. 

2A051;  2A071 

A=F-15;  B=AII  helos  and 
acft  other  than  F-16: 
C=Sensors  for  all  helos  and 
acft:  D=EWS  for  all  helos 
and  acft 

2AOKO 

T,  AVIONICS  TST  STA  AND  COMP  JYMN/CRF 

Manages  and  directs  maintenance  functions  and 
activates.  Included  areas  are  avionics  sensors, 
communications  and  navigation,  guidance  and  control, 
airborne  warning  and  control  radar,  inertial  and  radar 
navigation,  airborne  command  post  communication 
systems,  avionics  test  stations,  electronic  warfare 
systems,  and  avionics  support  equipment. 

2A090: 2A000 

N/A 

2A3X0 

MXSUPT  (TACACFT) 

Manages  maintenance  activities  engaged  in  planning, 
inspecting,  and  servicing  tactical  aircraft  and  related 
support  equipment. 

2A390: 2A300 

N/A 

2A3X1 

AVIONICS  SYS  (A1 0/F1 5/U2)  JYMN/CRFTMN 

Isolates  malfunctions  and  repairs  and  inspects  A-10.  F- 
16.  and  U-2  integrated  avionics  systems  at  operational 
levels.  Inspects,  services,  and  performs  aircraft 
handling  procedures 

2A351: 2A371 

A=Attack  Control: 
B=lnstruments  and  Fit 
Controls:  C=Comm.  Nav.  & 
Pen  Aids 

2A3X2 

'IONICS  SYS  (FI  6/1 1 7/RQ1  /CV22)  JYMN/CRFTI 

Maintains  F-16.  F-117.  RQ-1.  and  CV-22  acft  avionics 
systems  at  the  organizational  level.  Performs  and 
supervises  general  acft  servicing  and  handling 
procedures. 

2A352: 2A372 

A=Attack  Control: 
B=lnstruments  and  Fit 
Controls:  C=Comm.  Nav.  & 
Pen  Aids 

2A3X3 

CREW  CHIEF  (TACACFT)  JYMN/CRFTMN 

Maintains  tactical  acft.  support  equipment,  and  forms 
and  records.  Performs  and  supervises  flight  chief, 
expediter,  crew  chief,  repair  &  reclamation,  quality 
assurance,  and  maintenance  support  functions 

2A353: 2A373 

ArF-15;  B=F-16/F-117: 
E=A-10;  F=T-1/T-38;  G=T- 
37/QA-37:  H=U-2 
J=General  acft  except  F- 
15/F-16 

2A590 

MX  SUPT  (NON-TAC  ACFT) 

Manages  maintenance  and  staff  activities  engaged  in 
maintenance  planning,  inspecting,  repairing,  and 
servicing  aircraft,  helicopters,  and  aerospace 
equipment. 

2A690 

N/A 

2A5X1 

OREW  CHIEF  (NON-TAC  ACFT)  JYMN/CRFTMI' 

Maintains  acft.  support  equipment,  and  forms  and 
records.  Performs  production  supervisor,  flight  chief, 
expediter,  crew  chief,  support,  aero  repair,  and 
maintenance  functions. 

2A651: 2A671 

A=C-9/C-20/C-21/C-22/C- 
141/T-39/T-43:  B=C-12/C- 
26/C-27/C-130:  C=C-5:  D=C 
17:  E=B-1/B-2;  F=B-52; 
G=C-1 8/C-1 35/E-3A/C- 
25/VC-137:  H=KC-10/E4: 
J=C-5/C-9/C-12/C-1 7/C- 
20/C-21/C-22/C-26/C-27/C- 
130/C-141/T-39/T43:  K=B- 
1/B-2/B-62:  L=AII  C-136/C- 
1 8/E-3/E4/KC-1 0/VC- 
25/VC-137. 

2A5X2 

CREW  CHIEF  (HELO)  JYMN/CRFTMN 

Performs  and  supervises  helicopter  maintenance 
functions  and  activities.  Inspects,  repairs,  maintains, 
and  services  helicopters  and  support  equipment. 
Maintains  acft  forms  and  records  Performs  crew  chief 
functions 

2A552: 2A672 

A=MH-53;  B=H-60:  C=H-1 

2A5X3 

VIONICS  SYS  (NON-TAC  ACFT)  JYMN/CRFTMI 

Analyzes  malfunctions:  inspects,  removes,  maintains, 
and  installs  integrated  avionics  systems.  Performs  and 
supervises  maintenance  and  general  acft  servicing  and 
handling. 

2A553: 2A673 

A=  Comm.  Nav.  and 
Mission:  B=lnst  and  Fit 
Cont:  C=EW:  D=Airbome 
Surv  Radar  Systems 
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2A600 

ACFT  SYS  SUPERINTENDENT 

Manages  maintenance  functions  in  aircrew  egress 
systems,  and  aircraft  fuel,  in-flight  refueling,  hydraulic, 
electrical,  and  environmental  systems 

2A600 

N/A 

2AGX1 

PROP  JYMN/CRFTMN/SUPERINTENDENT 

Inspects,  maintains,  modifies,  tests,  and  repairs 
propellers,  turboprop  and  turbine  engines,  jet  engines, 
small  gas  turbine  engines,  and  engine  ground  support 
equipment.  Manages  aerospace  propulsion  functions 
and  activities. 

2A651: 2A671: 
2A691 

A=Jet  Eng:  B=Turboprop 
and  Turbo  shaft  Propulsion: 
C=TF33/CF6/F  103/FI  08/F 1 
17/JT3D- 

3/TF34/TF39/PW2020  Jet 
Eng:  D=F100/F119  Jet  Eng; 
E= F 1 0 1  /F 1 1 0/F 1 1 8/F404/J  8 

5  Jet  Eng. 

2A6X2 

AGE  JYMN/CRFTMN 

Maintains  aerospace  ground  equipment  (AGE)  to 
support  acft  systems  or  subsystems.  Manages  AGE 
functions  and  activities. 

2A652: 2A672: 
2A692 

N/A 

2A6X3 

EGRESS  SYS  JYMN/CRFTMN 

Maintains  acft  egress  systems  including  ejection  seats, 
canopies,  hatches,  and  modules:  explosive 
components;  electro-explosive  devices:  subsystems: 
and  related  support  equipment. 

2A653: 2A673 

N/A 

2A6X4 

FUEL  SYS  JYMN/CRFTMN 

Removes,  repairs,  inspects,  and  modifies  acft  fuel 
systems  including  integral  fuel  tanks,  bladder  cells,  and 
external  tanks.  Maintains  assoicated  hardware  and 
equipment. 

2A654: 2A674 

N/A 

2AGX5 

HYDR  SYS  JYMN/CRFTMN 

Troubleshoots,  removes,  repairs,  overhauls,  inspects, 
and  installs  acft  hydraulic  systems  and  components, 
including  support  equipment. 

2A655: 2A675 

N/A 

2A6X6 

ELEC/ENV  SYS  JYMN/CRFTMN 

Performs  and  supeivises  acft  electrical  and 
environmental  (E&E)  functions  and  activities. 
Troubleshoots,  inspects,  removes,  installs,  repairs, 
modifies,  overhauls,  and  operates  acft  E&E  systems, 
components,  and  associated  support  equipment. 

2A6556: 2A676 

N/A 

2A7X1 

AIRCRAFT  METALS  TECHNOLOGY 

Designs,  welds,  heat  treats,  fabricates,  and  machines  precision 
tools,  components,  and  assembles  for  aerospace  weapons 
systems  and  realetd  support  equipment 

2A751;  2A771 

N/A 

2A7X2 

NON-DESTRUCTIVE  INSPECTION 

Inspects  aerospace  weapons  systems  components  and  support 
equipment  for  structural  integrity  using  non-destructive  methoda 
and  performs  fluid  analysis. 

2A752;  2A772 

N/A 

2A7X3 

STRUCT  MX  JYMN/CRFTMN 

Designs,  repairs,  modifies,  and  fabricates  acft  metal,  plastic, 
composite,  advanced  composite,  low  observables,  and  bonded 
structural  parts  and  components.  Apples  preservative  treatments 
to  acft,  missiles,  and  support  equipment. 

2A753;  2A773 

N/A 

2A7X4 

SURV  EQUIP  JYMN/CRFTMN 

Disassembles,  assembles,  inspects,  fabricates,  cleans,  repairs, 
and  packs  aerospace  weapons  system  component  such  as 
protective  clothing,  upholstery,  thermal  radiation  barriers, 
protective  covers,  flotation  equipment,  emergency  evacuation 
systems,  parachutes. 

2A754;  2A774 

N/A 
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2E1X1 

SAT,  WIDEBAND,  AND  TELEMETRY  SYS  JYMN/CRFTMN 

Deploys,  operates,  and  sustains  ground  and  space-based  satellite, 
Beyond  Line-of-Sight,  wideband  communication,  telemetry,  and 
instrumentation  systems.  Manages  and  performs  design  support, 
installation,  calibration,  testing,  operation,  maintenance,  and  repair 
of  facilities,  systems  equipment,  and  related  subsystems. 

Monitors,  analyzes,  and  directs  performance  checks  and 
measurements  to  ensure  acceptable  performance.  Configures 
equipment.  Establishes  and  maintains  communications  links  with 
distant  terminals.  Operates  earth  terminal  control  console  and 
monitors  system  performance  indicators.  Implements  operations 
directives.  Manages  wideband  and  satellite  earth  terminal  facilities 
or  activities. 

2E151;  2E171 

m 

2E2X1 

COMP  NETWORK  SWITCHING  AND  CRYPTO  SYS 

Sustains  network  infrastructure,  cryptographic  equipment,  and 
deployable  swiching  systems  in  a  fixed  and  deployed 
environment.  Sustains  and  operates  systems  through  effective 
troubleshooting,  repair,  diagnostics,  and  system  performance 
analysis. 

2E251;  2E271 

m 

2M0X1 

MSL/SPC  SYS  MX  JYMN/CRFTMN 

Maintains,  operates,  and  supervises  maintenance  on  ground  and 
air  missiles,  unmanned  aerial  vehicles  (UAV),  space  lift  boosters, 
payload  guidance  and  control  systems  and  subsystems.  Monitors, 
analyzes,  and  compiles  system  performance  data.  Supervises 
maintenance  on  automated  and  manual  electronic  test,  launch 
control,  checkout,  and  support  equipment.  Designs  and 
supervises  assembly,  calibration,  operation,  troubleshooting,  and 
testing  of  research  and  development  systems  and  support 
equipment.  Launches,  tracks,  and  recovers  UAVs,  and  operates 
and  maintains  support  equipment. 

2M051;  21,1071 

A=ICBM;  B=ALCM 

2W0X1 

MUNSYS  JYMN/CRFTMN 

Performs  and  manages  munitions  production  and  material  tasks 
and  activities.  Identifies  munlions  and  equipment  requirements. 
Operates  and  maintains  automated  data  processing  equipment  to 
perform  munitions  accounting,  computations,  and  research. 

Stores,  maintains,  assembles,  issues,  and  delivers  assembled  non¬ 
nuclear  munlions.  Routinely  demilitarizes  nonhazardous  munlions. 
Operates  and  maintains  munlions  material  handling  equipment. 
Develops  and  implements  munlions  material  management  concepts 
and  procedures.  Complies  wlh  explosive,  missile,  and  ground 
safety,  security,  and  environmental  directives  and  practices. 
Identifies  munlions  by  filler  color  code,  marking,  or  physical 
characteristics,  receives,  stores,  handles,  and  transports  nuclear 
weapons. 

2W051;  2W071 

m 

2W1X1 

ACFT  ARM  SYS  JYMN/CRFTMN 

Loads  and  unloads  nuclear  and  non-nuclear  munlions,  explosives, 
and  propellant  devices  from  acft.  Manages,  controls,  maintains, 
and  installs  act  bomb,  rocket,  missile  release,  launch,  suspension, 
monior  systems;  guns  and  gun  mounts;  and  related  munlions 
handling,  loading,  and  test  equipment. 

2W151;  2W171 

C=A-10;  D=F-4;  E=F-15;  F=F-16; 
H=F-111;  K=B-52;  L=B-1;Z=AII 
Other 

2W100 

SUPT.ACFT  ARMAMENT  SYSTEMS 

Loads  and  unloads  nuclear  and  non-nuclear  munlions,  explosives, 
and  propellant  devices  from  acft.  Manages,  controls,  maintains, 
and  installs  act  bomb,  rocket,  missile  release,  launch,  suspension, 
monior  systems;  guns  and  gun  mounts;  and  related  munlions 
handling,  loading,  and  test  equipment. 

2W191, 2W100 

m 

2W2X1 

NUCWPNS  JYMN/CRFTMN 

Performs  and  manages  maintenance,  inspection,  storage,  handling, 
modification,  accountability,  and  repair  of  nuclear  weapons 
components,  associated  equipment,  and  general  or  specialized 
test  and  handling  equipment. 

2W251;  2W271 

m 

275 


Bibliography 


AFLMA.  Maintenance  Metrics:  U.S.  Air  Force.  Air  Force  Logistics  Management 

Agency/LGM.  Maxwell  Air  Force  Base,  Gunter  Annex,  AL.  March  2002,  (LM 
200119700). 

Air  Force  Instruction  36-2 1 .  Utilization  and  Classification  of  Air  Force  Military 

Personnel.  HQ  USAF/DPXFC.  Randolph  Air  Force  Base,  TX,  April  1,  1998. 

Air  Force  Instruction  36-2101.  Classifying  Military  Personnel  (Officer  and  Enlisted). 
HQ  AFPC/DPPAC.  Randolph  Air  Force  Base,  TX,  April  30,  2001. 

Air  Force  Instruction  38-20 1 .  Determining  Manpower  Requirements.  HQ 
USAF/XPMR.  Pentagon,  Washington,  DC,  December  30,  2003. 

Air  Force  Instruction  38-204.  Programming  USAF Manpower.  HQ  AFPC/XPMR. 
Randolph  Air  Force  Base,  TX,  August  1,  1999. 

Air  Force  Manual  38-208.  Air  Force  Management  Engineering  Program  (MEP) 

Logistics  Composite  Model.  HQ  USAF/PER.  Randolph  Air  Force  Base,  TX, 
April  30,  2001. 

Akpinar,  Muammer.  Requirements  and  Mission  Effectiveness  for  the  F-16 

Implementation  by  the  Turkish  Air  Force.  MS  thesis,  Air  Force  Institute  of 
Technology,  Wright-Patterson  Air  Force  Base,  OH,  December  1986 
(ADA179335). 

Clayton,  M.  J.  Delphi:  A  Technique  to  Harness  Expert  Opinion  for  Critical  Decision- 
Making  Tasks  in  Education.  Educational  Psychology,  17  (4).  1997. 

Dalkey,  Norman  C.  “The  Delphi  Method:  An  Experimental  Study  of  Group  Opinion.” 
The  RAND  Corporation.  Santa  Monica,  CA,  1969. 

Dalkey,  N.  C.;  Rourke,  D.  L.;  Snyder,  D.  Studies  in  the  Quality  of  Life.  Lexington 
Books,  Lexington,  MA,  1972. 

Determan,  Jon  R.  Inaccurate  Data  Entry  into  the  Air  Force  Maintenance  Data 
Collection  System.  MS  thesis,  Air  Force  Institute  of  Technology,  Wright- 
Patterson  Air  Force  Base,  OH,  September  20,  1991  (AD-A246876). 

Devers,  Waynard  C.;  Bailey,  Elizabeth  K.;  Dymond,  Lee  H.;  Florae,  William  A.; 

Horowitz,  Stanley  A.  A  Comparison  of  Air  Force  Data  Systems.  Institute  for 
Defense  Analysis,  Alexandria,  VA,  August  1993  (AD-  A269691). 


276 


Fine,  William  T.  A  Management  Approach  in  Accident  Prevention.  Naval  Surface 

Weapons  Center,  White  Oak  Lab,  Silver  Spring  MD,  July  1975,  (AD-A014562). 

General  Accounting  Office,  Washington,  D.C.  National  Security  and  International 

Affairs  Div.  “Best  Practices:  Commercial  Quality  Assurance  Practices  Offer 
Improvements  for  DoD,  ”  Report  Number:  GAO/NSIAD-96-162,  August  26,  1996 
(AD-A3 13504). 

Gray,  Mark  A.;  Ranalli,  Margaret  M.  An  Evaluation  of  Aircraft  Maintenance 

Performance  Factors  in  the  Objective  Wing.  MS  thesis,  Air  Force  Institute  of 
Technology,  Wright-Patterson  Air  Force  Base,  OH,  September  1993  (AD- 
A276010). 

Grier,  Peter.  Board  Partly  Clears  Airman  in  F-15  Crash.  Aerospace  World,  Volume  81, 
No.  6,  June  1998. 

Hernandez,  Alison  E.  Organizational  Climate  and  Its  Relationship  with  Aviation 

Maintenance  Safetv.  MS  thesis,  Naval  Post  Graduate  School,  Monterey,  CA, 

June  2001  (AD-A3 92098). 

Holzbach,  R.  L.,  Jr.;  Williams,  H.  L.  Enlisted  Manning  Levels  and  Ship  Performance.  : 
Navy  Personnel  Research  and  Development  Center,  San  Diego,  CA,  1991  (AD- 
A141452). 

Illinois  Institute  of  Technology  (n.d.).  The  Delphi  Method. 
(http://www.itt.edu/~it/delphi.html). 

Johnson,  Charles  D.  USAF  Aircraft  Maintenance  Management.  Is  There  a  Better  Way? 
MS  thesis,  Air  Command  and  Staff  College,  Maxwell  Air  Force  Base,  AL.  April 
2000  (AD-A393953). 

Linstone,  Harold  A.;  Turoff,  Murray.  The  Delphi  Method:  Techniques  and  Applications. 
Addison-Wesley  Publishing  Co.  Reading,  MA.  1975. 

Ludwid,  Barbara.  Predicting  the  Future:  Have  You  Considered  Using  the  Delphi 
Methodology?  Journal  of  Extension  35(5). 
(http://www.ioe.org/ioe/1997.october/tt.html). 

Moening  Jeffrey.  Air  Force  Safety  Center.  Kirtland  AFB,  NM.  Quotable  E-mail 
responses  to  telephone  conversation,  received  January  18,  2005. 

Oliver,  Steven  A.  Forecasting  Readiness:  Using  Regression  to  Predict  the  Mission 

Capability  of  Air  Force  F-16  Fighter  Aircraft.  MS  thesis,  The  Air  Force  Institute 
of  Technology,  Wright-Patterson  Air  Force  Base,  OH,  March  2001  (AD- 
A276010). 


277 


OPNAVINST  4790. 2H  (2001).  Naval  Aviation  Maintenance  Program  Instruction, 
Volume  1,  Chapter  14,  Quality  Assurance  Division. 
http://logistics.navair.navy.mil/4790/. 

Oxley,  Les.  The  ‘Top  10”  Papers  in  Econometrics .  Invited  Paper  Presented  to  the  New 
Zealand  Statistical  Association  Meeting,  University  of  Canterbury,  September, 
2000. 

Podsakoff,  Philip  M.;  Organ,  Dennis  W.  Self  Reports  in  Organizational  Research: 
Problems  and  Prospects.  Journal  of  Management,  Vol.12,  No  4,  1986. 

Sansavera,  David.  HQ  ACC/LGQT.  Telephone  interview  conducted  January  26,  2005. 
Langley  Air  Force  Base,  VA. 

USASC.  Stopping  Accidents  in  Maintenance  Operations.  Army  Safety  Center,  Fort 
Rucker,  AL,  February  1991  (AD-A373177). 

Walker,  William  N.  Mishap  Trend  Analysis  Regarding  Maintenance  Discipline  and 

Compliance.  Air  Force  Logistics  Management  Agency,  Gunter  Air  Force  Base, 
AL,  March  1997  (AD-A323 169). 

Webb,  Lloyd.  2d  Bomb  Wing,  Barksdale  Air  Force  Base,  LA  Wing  Foreign  Object 

Damage/Dropped  Object  Prevention  Non-Commissioned  Officer.  Quotable  E- 
mail  response  to  telephone  conversation,  received  March  1 1,  2005. 


278 


Vita 


Chief  Master  Sergeant  Terry  D.  Moore  was  bom  and  raised  in  South  Carolina.  He  enlisted  in  the  United 
States  Air  Force  in  September  1979,  and  completed  the  Avionics  Flight  Control/Instruments  Apprentice  Course 
at  Chanute  Air  Force  Base,  Illinois.  He  earned  his  Associates  Degree  in  Avionics  Systems  Technology  from 
the  Community  College  of  the  Air  Force  and  his  Bachelor  of  Science  Degree  in  Professional  Aeronautics  from 
Embry-Riddle  Aeronautical  University. 

His  prior  duty  assignments  include  Hill  Air  Force  Base,  Utah;  Kunsan  Air  Base,  Republic  of  Korea; 
Shaw  Air  Force  Base,  South  Carolina;  Nellis  Air  Force  Base,  Nevada;  Moody  Air  Force  Base,  Georgia; 
Ramstein  Air  Base,  Germany;  Aviano  Air  Base,  Italy,  Langley  Air  Force  Base,  Virginia.  In  September  2003, 
he  entered  the  Acquisitions  Logistics  and  Graduate  Logistics  Management  Programs  at  the  Air  Force  Institute 
of  Technology  (AFIT),  Wright-Patterson  Air  Force  Base,  Ohio.  Upon  graduation  from  AFIT  he  will  be 
assigned  to  Headquarters,  Air  Force  Material  Command  at  Wright-Patterson  Air  Force  Base  as  the  Command 
2A0,  2A6,  and  2A7  Career  Field  Manager. 


279 


REPORT  DOCUMENTATION  PAGE 

Form  Approved 

OMB  No.  074-0188 

The  public  reporting  burden  for  this  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  the  collection  of  information,  including 
suggestions  for  reducing  this  burden  to  Department  of  Defense,  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports  (0704-0188),  1215  Jefferson  Davis  Highway, 

Suite  1204,  Arlington,  VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  an  penalty  for  failing  to  comply  with  a  collection  of 
information  if  it  does  not  display  a  currently  valid  OMB  control  number. 

PLEASE  DO  NOT  RETURN  YOUR  FORM  TO  THE  ABOVE  ADDRESS. 

1 .  REPORT  DATE  (DD-MM-YYYY)  2.  REPORT  TYPE 

17-03-2005  Master’s  Thesis 

3.  DATES  COVERED  (From  -  To) 

Sep  2004  -  Mar  2005 

4.  TITLE  AND  SUBTITLE 

EXAMINING  THE  IMPACT  OF  QUALITY  ASSURANCE  MANNING 

PRACTICES  IN  USAF  AIRCRAFT  MAINTENANCE  UNITS 

5a.  CONTRACT  NUMBER 

5b.  GRANT  NUMBER 

5c.  PROGRAM  ELEMENT  NUMBER 

6.  AUTHOR(S) 

Moore,  Terry  D.,  Chief  Master  Sergeant,  USAF 

5d.  PROJECT  NUMBER 

5e.  TASK  NUMBER 

5f.  WORK  UNIT  NUMBER 

7.  PERFORMING  ORGANIZATION  NAMES(S)  AND  ADDRESS(S) 

Air  Force  Institute  of  Technology 

Graduate  School  of  Engineering  and  Management  (AFIT/EN) 

2950  Hobson  Street,  Building  642 

WPAFB  OH  45433-7765 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

AFIT/GLM/ENS/05-1 8 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

Air  Force  Air  Combat  Command  (ACC) 

ACC/LGQ  Attn:  CMSgt  Kenneth  Callahan 

130  Douglas  Street  COMM:  (757)  764-5502 

Lanalev  AFB,  VA  23665  e-mail:  kenneth.callahanf®, lanalev.af.mil 

10.  SPONSOR/MONITOR’S  ACRONYM(S) 

11.  SPONSOR/MONITOR’S  REPORT  NUMBER(S) 

12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

APPROVED  FOR  PUBLIC  RELEASE;  DISTRIBUTION  UNLIMITED 


13.  SUPPLEMENTARY  NOTES 


14.  ABSTRACT  The  purpose  of  this  research  was  to  examine  the  impact  that  current  USAF  Quality  Assurance  (QA)  manning 
practices  has  on  key  aircraft  wing-  and  unit-level  metrics.  Interviews  and  surveys  culminated  in  development  of  a  QA  Manning 
Effectiveness  Matrix.  We  then  used  the  matrix  to  calculate  historical  QA  manning  effectiveness  at  16  ACC  bases.  Effectiveness 
scores  were  regressed  with  associated  historical  data  for  26  metrics  derived  from  a  Delphi  survey.  Nine  metrics  were  deemed 
statistically  significant,  including  break  rates,  cannibalization  rates,  flying  schedule  effectiveness  rates,  key  task  list  pass  rates, 
maintenance  scheduling  effectiveness  rates,  quality  verification  inspection  pass  rates,  repeat  rates,  dropped  objects  counts  and 
safety/technical  violations  counts.  An  example  benefit  cost  analysis  for  changes  in  QA  manning  effectiveness  was  performed,  using 
reasonable  cost  values.  The  results  present  compelling  evidence  for  maintenance  managers  to  carefully  weigh  decisions  to  leave 
QA  manning  slots  empty,  or  to  assign  personnel  possessing  other  than  authorized  credentials.  Maintenance  managers  can  use  this 
tool  to  help  determine  mitigating  strategies  for  improving  unit  performance  with  respect  to  the  nine  metrics. 


15.  SUBJECT  TERMS 

Quality  Assurance  Manning  Effectiveness,  Unit  Manpower  Document,  Maintenance  Metrics,  USAF  Accident  Rate,  Dropped 
Object,  Foreign  Object  Damage,  Safety,  Mission  Capable  Rate,  Statistical  Correlation  Analysis,  Benefit  Cost  Ratio  Analysis,  Delphi 
Study,  Computer-Based  Survey. 


16.  SECURITY  CLASSIFICATION  OF: 

17.  LIMITATION  OF 

18.  NUMBER 

19a.  NAME  OF  RESPONSIBLE  PERSON 

ABSTRACT 

OF 

PAGES 

Alan  W.  Johnson 

a.  REPORT 

b.  ABSTRACT 

c.  THIS  PAGE 

19b.  TELEPHONE  NUMBER  (Include  area  code) 

u 

u 

u 

UU 

297 

(937)  255-3636,  ext  4703;  e-mail:  alan.johnson@afit.edu 

280 


